long context

Gemini 1.5 Pro

Introduced the 1M–2M token context window on a mixture-of-experts architecture.