According to a fresh leak, which was kindly shared by The Verge, Sony is developing a prototype of at least one AI-powered PlayStation game character.
In the demo, the AI version of Aloy (without leaving the character’s image) answers the user’s questions, takes him to Horizon Forbidden West, and, following the gameplay session, recounts everything that happened in it in a condensed form.
According to Sharwin Raghoebardajal, an employee of PlayStation Studios Advanced Technology Group, the AI version of Aloy is based on several technologies:
- Whisper speech recognition system from OpenAI;
- large language models GPT-4 (OpenAI) and Llama 3 (Meta) — responsible for conversation and decision-making;
- Sony’s own system, Emotional Voice Synthesis, is used for voice synthesis;
- another Sony system, Mockingbird, is used to generate facial animation.
The leaked video was quickly removed from YouTube due to copyright infringement. The claimant was Muso, whose client list includes Sony Interactive Entertainment.