Ahead of the Game Developers Conference (GDC), Xbox revealed on Thursday that it’s experimenting with an AI-powered gaming sidekick.
“Copilot for Gaming,” powered by Microsoft’s AI technology, is a voice-activated assistant designed to enhance the gaming experience and is designed to answer questions, complete tasks, and even criticize if you’re playing poorly.
“It can trash talk you if that’s what you need,” said Fatima Kardar, corporate vice president of gaming AI at Microsoft, in an episode of Xbox’s official podcast released on Thursday.
In a briefing with the press, the company demonstrated several use cases, such as providing real-time tips — like suggesting which Overwatch character to pick for your team based on their strengths.
It even looks at your past character selections on a particular map. The AI can also advise you on your next move to win the fight and how to improve in future encounters.
Xbox partnered with game studios to ensure that the AI’s responses are accurate since information found on the internet can sometimes be misleading or outdated, Kardar explained. This means that when you ask the Copilot for help with a game (though it won’t let you cheat), it will provide you with the correct information.
Additionally, it can notify you when your friends are online and ask if you want to jump into a game with them. If your friends are offline, however, the Copilot can serve as a companion that adapts to your gameplay style.
Other smaller tasks the AI can handle include reminding you what happened during your last gaming session, installing games for you, and recommending new titles based on your preferences.
Currently, Copilot for Gaming is available only through the Xbox mobile app and will pull up as a second screen while you play a game. Xbox plans to improve the feature based on user feedback.
Other companies exploring AI agents for video games include Google and Sony, among others. For instance, last year, Google DeepMind researchers developed SIMA, a game-playing companion that plays alongside users and can be given instructions. Sony PlayStation is reportedly working on an AI-powered version of Aloy, a character from the video game Horizon Forbidden West, according to The Verge.