Tech giant Google has announced the addition of two new features to Google Translate that facilitate real-time conversation translation and personalized language practice. Utilizing the advanced reasoning and multimodal capabilities of Gemini models, Google aims to enhance live conversations and language learning. The updated Google Translate App now supports live, two-way conversations in over 70 languages, such as Arabic, French, Hindi, Korean, Spanish, and Tamil, providing audio and on-screen translations. To utilize this feature, users can open the Translate App on Android or iOS, tap on ‘Live translate,’ select their preferred languages, and begin speaking. The translation will be vocalized with an on-screen transcript of the conversation displayed in both languages.
These live translation capabilities are available starting today for users in the US, India, and Mexico, leveraging advanced speech recognition technology to ensure clarity even in noisy environments. Google emphasized that its live translation features utilize sophisticated voice and speech recognition models designed to isolate sounds, making them effective in bustling settings like airports or cafes. Additionally, a Beta language practice feature will be launched this week, offering tailored listening and speaking exercises for English speakers learning Spanish and French, as well as for Spanish, French, and Portuguese speakers learning English. Users can initiate this feature by tapping ‘Practice’ in the App, setting their skill level and goals, after which Translate will create customized scenarios for them.
Learners have the option to listen to conversations and tap the words they hear to improve comprehension or practice speaking with supportive tips. Google stated that these interactive practices are generated dynamically and adapt intelligently to the learner’s skill level.