SEC.03 / LLM Research
Small Language Models Explained: How Phi, Gemma, Llama 3.2 and Apple's On-Device Models Compete, and When to Use One
Why small language models have become capable enough for real work: data quality, synthetic data and distillation, what Phi-3, Phi-4, Gemma, Llama 3.2 and Apple's on-device model show, where small models win and fall short, and how to decide between a small, large or hybrid setup.