AWS

Amazon Launches Nova 2 Sonic Speech-to-Speech Model for Advanced Conversational AI


Executive Summary

Amazon has announced the general availability of Nova 2 Sonic, a new speech-to-speech foundation model on Amazon Bedrock designed for creating natural, real-time voice applications. This updated model improves upon its predecessor with enhanced intelligence, better speech understanding, and expanded language support, including polyglot voices that can switch languages mid-conversation. New capabilities like asynchronous tool calling, crossmodal (text/voice) interactions, and direct telephony integration aim to help developers build more sophisticated and human-like conversational agents for a global audience.

Key Takeaways

* Expanded Language & Polyglot Support: Adds Portuguese and Hindi to its language roster and introduces "polyglot voices" capable of switching between all supported languages in a single conversation.

* Enhanced Intelligence & Performance: The model shows improved performance on key industry benchmarks for reasoning (Big Bench Audio), function calling (BFCL), and handling complex, multi-step tasks.

* Advanced Conversational Features: Introduces asynchronous tool calling, allowing the model to handle new user requests while background tasks run. It also supports crossmodal input (switching between voice and text) and configurable turn-taking sensitivity.

* Improved Speech Recognition: Offers greater accuracy for challenging audio, including 8KHz telephony speech, alphanumeric inputs, various accents, and background noise.

* Direct Telephony Integration: Provides direct integration with major telephony platforms like Amazon Connect, Vonage, and Twilio, simplifying deployment in call centers and IVR systems.

* Availability: Nova 2 Sonic is now generally available via Amazon Bedrock in the US East (N. Virginia), US West (Oregon), Asia Pacific (Tokyo), and Europe (Stockholm) AWS regions.

Strategic Importance

This launch solidifies AWS's position as a key competitor in the advanced conversational AI space, directly challenging other major cloud providers. By integrating sophisticated features like polyglot voices and asynchronous agentic capabilities into its Bedrock platform, Amazon lowers the barrier for enterprises to build and deploy complex, global-scale voice AI applications.

Original article