Research paper
Gemma 4 Technical Report
Gemma 4 is a new family of open-weight, natively multimodal language models from Google DeepMind, featuring dense (2.3B, 4.5B, 12B, 31B) and Mixture-of-Experts (26B total, 3.8B active) architectures. Key innovations include a thinking mode for reasoning traces, an encoder-free architecture for the 12B model that processes raw audio and image patches, and…
Gemma Team, Sherif El Abd, Vaibhav Aggarwal, Robin Algayres, et al.- Published
- Jul 2026
- Citations
- 18
- Code
- Not linked