Sony tests artificial intelligence in PlayStation characters

Stefani Couto
A journalist by training, a gamer by passion! I write about games, trivia, and guides to help other players explore this incredible universe. If there's a new game...

Sony is experimenting with artificial intelligence to improve character interactivity in its PlayStation franchises. A leak revealed an internal demo featuring Aloy, the protagonist of Horizon Forbidden West. In the video, she answers questions posed by a player in real time, using a synthesized voice and facial expressions that match her lines.

The video, initially seen by The Verge, was removed from YouTube, but generated widespread industry buzz. Narrated by Sharwin Raghoebardajal, director of software engineering at Sony Interactive Entertainment, the video showcases a prototype developed in partnership with Guerrilla Games. The initiative is part of an experimental Sony project investigating how AI can create more immersive gaming experiences.

Aloy with the AI prototype
Photo: Disclosure/The Verge,

To achieve this level of interactivity, the company uses advanced technologies, including OpenAI's text-to-speech and the GPT-4 and Llama 3 language models. The company's proprietary Emotional Voice Synthesis (EVS) technology is responsible for the character's voice, while the Mockinbird system handles lip-syncing and facial expressions. The demo was conducted on a PC, but according to Raghoebardajal, it could run on the PlayStation 5 with some modifications.

AI is already impacting game development and generating debate in the industry

The use of artificial intelligence in the gaming industry has been growing, with 49% of the 3,000 developers interviewed in the Game Developers Conference (GDC) 2024 survey stating they already use generative AI tools in their work. Companies like Activision are also exploring the technology, but they face criticism, as in the recent case of the use of AI-generated images in marketing campaigns.

The adoption of AI in games opens up unprecedented possibilities, enabling greater interactivity and new forms of storytelling. However, the technology also raises concerns about its impact on creativity and the role of human developers. While some companies see AI as a way to streamline processes and reduce costs, part of the community fears that excessive use could compromise the artistic identity of games.

Sony artificial intelligence
Photo: Disclosure/Sony

Technology can revolutionize the way players interact with games

While Sony hasn't yet officially announced plans to implement AI in future releases, the Aloy demo suggests a growing interest in the technology. Raghoebardajal described the experiment as "a glimpse of what's possible," without detailing how it could be applied to commercial games.

If developed correctly, AI can transform the way players interact with NPCs (non-playable characters), making interactions more dynamic and personalized. However, technical and creative challenges still need to be overcome before this innovation becomes a market standard.

For now, Sony's test is an indication that the industry is moving toward a future where artificial intelligence could play a fundamental role in the evolution of games. The question remains: to what extent will this technology be used to enhance the player experience without compromising the human labor behind game creation?

Follow:
A journalist by training, a gamer by passion! I write about games, trivia, and guides to help other players explore this incredible universe. If there's a new game in the field, I'm always on the lookout and ready to turn the experience into a great article.