They say all the models were distilled from a teacher model but they didn't spec... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		YetAnotherNick on March 12, 2025 \| parent \| context \| favorite \| on: Gemma 3 Technical Report [pdf] They say all the models were distilled from a teacher model but they didn't specify what that teacher model is. Interesting thing to hide.

LeoPanthera on March 12, 2025 [–]

It's a safe bet that it's either one of the Gemini models or a relative of it.

YetAnotherNick on March 12, 2025 | [–]

That's what I thought. And it could be pulicity of Gemini as well that it is so good that it can teach students say 5x faster. If it is Gemini, there isn't any reason to hide. My bet is it is some unreleased Gemma or some model.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact