Gemma 3n ships as full open weights: 8B parameters in ~3GB of memory, commercial use permitted
Google DeepMind moved Gemma 3n from its I/O preview to full release on June 26, shipping two on-device sizes: E2B, with about 5B raw parameters and a roughly 2GB accelerator footprint, and E4B, with about 8B raw parameters and a roughly 3GB footprint. Both carry a 32K-token context window and accept text, image, audio and video input, and the weights landed the same day in Hugging Face transformers, llama.cpp, MLX, Ollama, transformers.js and Google AI Edge. The license is the Gemma Terms of Use, which permits commercial use; NVIDIA's launch-day write-up lists the checkpoints at 1.55GB (E2B) and 2.82GB (E4B) on disk.
The reason a sub-10B model is worth reading about here is the architecture. E2B is a genuine nested sub-network of E4B, trained with MatFormer, and Per-Layer Embeddings push the embedding matrix off the accelerator to CPU memory — which is why E4B runs with the footprint of a 4B model rather than an 8B one. Mix-n-match lets you slice intermediate effective sizes between 2B and 4B per layer, and the instruction-tuned E4B is the first sub-10B model to clear 1,300 Elo on LMArena.

WHY IT MATTERS
If any part of your stack needs a local model — offline features, privacy-bound inference, edge or robotics — a multimodal 3GB checkpoint under a commercially usable license removes both the API bill and the network round-trip, and it runs on hardware you already own. Test it against your own task before assuming parity with a hosted frontier model: the memory saving comes from offloading embeddings and nesting, not from shrinking the network, and capability varies by modality.





