AI companies are constantly vying for supremacy in the industry, but sometimes they find themselves battling it out in Pokémon gyms as well. Google and Anthropic have been studying how their latest AI models navigate early Pokémon games, and the results are as amusing as they are enlightening.
Gemini’s Panic Mode
Google DeepMind reported that its Gemini 2.5 Pro AI tends to panic when its Pokémon are close to fainting. This panic mode can lead to a noticeable decline in the AI’s reasoning capabilities, affecting its performance. While AI benchmarking may not always provide a clear picture of a model’s true capabilities, studying how AI models play video games can offer valuable insights.
AI Plays Pokémon
Two developers have set up Twitch streams called “Gemini Plays Pokémon” and “Claude Plays Pokémon,” allowing viewers to watch AI navigate through a classic children’s video game. Despite the impressive progress made by these AI models, they still struggle to play Pokémon efficiently, taking much longer than a human player would.
Unconventional Strategies
One fascinating aspect of observing AI play Pokémon is witnessing its unconventional behaviors. For instance, Claude mistakenly believed that fainting all of its Pokémon would transport it to a Pokémon Center in another town, showcasing the AI’s unique approach to problem-solving. While AI may not experience emotions, its actions can mimic human-like responses when faced with challenges.
Despite its shortcomings, the AI can outperform human players in certain aspects. Gemini 2.5 Pro has demonstrated the ability to solve puzzles with high accuracy and even create tools to navigate through the game more efficiently. With the AI’s potential to improve independently, who knows what innovative solutions it may come up with in the future.
