[sethkim]

Yes! Both Llama 3 and Gemma 3 have 128k context windows.

[ryao]

Llama 3 had a 8192 token context window. Llama 3.1 increased it to 131072.