Gemma is Google’s new “family of lightweight, state-of-the-art open models” aimed at AI developers and researchers.
Gemma was developed by Google DeepMind and other teams across the company, and is “built from the same research and technology used to create the Gemini models,” including technical and infrastructure components. Name-wise, it’s Latin for “precious stone.”
It’s available in Gemma 2B and Gemma 7B sizes today with accompanying pre-trained and instruction-tuned variants. For the former, Google has filtered out “certain personal information and other sensitive data from training sets.” It has undergone “manual red-teaming, automated adversarial testing, and assessments of model capabilities for dangerous activities.”
I would love to see how it fares against llama2