Google’s Gemini 1.5 Pro AI Model to Feature Expanded Two Million Token Context Window
Google held its keynote session for the annual Google I/O event on Tuesday, focusing extensively on advancements in artificial intelligence (AI). The session highlighted several new AI models and upgrades to existing infrastructure. A key announcement was the introduction of a two million token context window for the Gemini 1.5 Pro AI model, now accessible to developers. Additionally, Google unveiled a faster variant of Gemini and introduced Gemma 2, the next generation of its small language models (SML).
CEO Sundar Pichai opened the event with one of the most significant announcements: the new two million token context window for Gemini 1.5 Pro. Earlier this year, Google had introduced a one million token context window, initially available only to developers. Now, this feature has been made publicly available for preview through Google AI Studio and Vertex AI. The newly announced two million token context window, however, is currently accessible via waitlist to developers using the API and to Google Cloud customers.
The expanded context window of two million tokens allows Gemini 1.5 Pro to process extensive amounts of data efficiently. According to Google, the AI model can now handle two hours of video, 22 hours of audio, over 60,000 lines of code, or more than 1.4 million words in a single pass. This significant enhancement is expected to vastly improve the model’s contextual understanding and performance.
In addition to the expanded context window, Google has enhanced various capabilities of Gemini 1.5 Pro. Improvements include better code generation, logical reasoning, planning, multi-turn conversation handling, and the comprehension of images and audio. These upgrades aim to provide a more robust and versatile AI model for developers and users alike.
Google is also integrating Gemini 1.5 Pro into its Gemini Advanced and Workspace apps, further embedding AI capabilities into its suite of tools. This integration is expected to enhance productivity and streamline workflows by leveraging advanced AI functionalities within commonly used applications.
Overall, the announcements at Google I/O 2024 underscore Google’s commitment to pushing the boundaries of AI technology. The introduction of the two million token context window for Gemini 1.5 Pro and the debut of new AI models like Gemma 2 signal significant advancements in AI’s ability to process and understand vast amounts of data, setting the stage for more innovative and intelligent applications in the future.
Finally, the tech giant announced the next generation of its smaller AI models, Gemma 2. The model comes with 27 billion parameters but can run efficiently on GPUs or a single TPU. Google claims that Gemma 2 outperforms models twice its size. The company is yet to release its benchmark scores.