{"id":96231,"date":"2026-06-09T17:44:39","date_gmt":"2026-06-09T17:44:39","guid":{"rendered":"https:\/\/youzum.net\/google-releases-gemini-3-5-live-translate-a-streaming-speech-to-speech-audio-model-covering-70-languages-across-meet-translate-and-the-live-api\/"},"modified":"2026-06-09T17:44:39","modified_gmt":"2026-06-09T17:44:39","slug":"google-releases-gemini-3-5-live-translate-a-streaming-speech-to-speech-audio-model-covering-70-languages-across-meet-translate-and-the-live-api","status":"publish","type":"post","link":"https:\/\/youzum.net\/th\/google-releases-gemini-3-5-live-translate-a-streaming-speech-to-speech-audio-model-covering-70-languages-across-meet-translate-and-the-live-api\/","title":{"rendered":"Google Releases Gemini 3.5 Live Translate, a Streaming Speech-to-Speech Audio Model Covering 70+ Languages Across Meet, Translate, and the Live API"},"content":{"rendered":"

Google just announced Gemini 3.5 Live Translate<\/strong><\/a>. It is their latest audio model for live speech-to-speech translation. Speech-to-speech means spoken audio goes in, and translated spoken audio comes out. The model detects over 70 languages automatically and generates translated speech. It preserves the speaker\u2019s intonation, pacing, and pitch in the output. Turn-by-turn systems wait for a speaker to finish before responding. Gemini 3.5 Live Translate generates speech continuously instead. It balances a trade-off between waiting for context and translating immediately. More context improves quality. Faster output keeps the translation in sync with the speaker. The result stays a few seconds behind the speaker throughout a session.<\/p>\n

Gemini 3.5 Live Translate<\/strong><\/h2>\n

Gemini 3.5 Live Translate is a single audio model (gemini-3.5-live-translate-preview<\/code>), not a chat assistant. It processes speech as the audio streams in, rather than after a full sentence. It handles multilingual inputs without manually configuring settings. Its noise robustness lets applications run in loud, unpredictable environments.<\/p>\n

The model is rolling out across three surfaces. Developers get it in public preview through the Gemini Live API and Google AI Studio. Enterprises get a private preview in Google Meet starting this month. Everyone else gets it through the Google Translate app on Android and iOS.<\/p>\n

How the Continuous Streaming Works<\/strong><\/h2>\n

The design difference matters for building real-time features. A conversational Live agent uses turn-based interactions. It relies on pauses, intent detection, and interruption handling. Live Translation uses continuous stream processing instead. It translates as the speaker talks, without waiting for turns to end.<\/p>\n

To hold strict real-time latency thresholds, the translation path accepts audio input only. Text input is not supported in translation mode. The model also drops tool use and system instructions in this mode. That keeps it a focused translator pipeline rather than a general agent.<\/p>\n

Building With the Live API<\/strong><\/h2>\n

Developers configure translation inside the Live API session setup. You set a translationConfig<\/code> block within the generationConfig<\/code>. The targetLanguageCode<\/code> field takes a BCP-47 code, such as \"pl\"<\/code> \u0e2b\u0e23\u0e37\u0e2d \"es\"<\/code>. BCP-47 is the standard format for language tags like en<\/code> \u0e2b\u0e23\u0e37\u0e2d pt-BR<\/code>. It defaults to \"en\"<\/code>. The echoTargetLanguage<\/code> boolean controls input that is already in the target language. When true<\/code>, the model echoes that speech. When false<\/code>, it stays silent. You can also enable inputAudioTranscription<\/code> and outputAudioTranscription<\/code> for text transcripts.<\/p>\n

Audio formats are fixed. Input is raw 16-bit PCM at 16kHz, mono, little-endian. Output is raw 16-bit PCM at 24kHz, mono, little-endian. PCM is uncompressed raw audio. You send audio in chunks of 100ms. For client-side apps, ephemeral tokens on the v1alpha<\/code> endpoint avoid exposing your API key.<\/p>\n

\n\n\n\n\n\n\n\n\n\n
Dimension<\/th>\nLive Agent<\/th>\nLive Translation<\/th>\n<\/tr>\n<\/thead>\n
Model role<\/td>\nAssistant that listens, reasons, and acts<\/td>\nInterpreter \/ real-time translator pipeline<\/td>\n<\/tr>\n
Interaction<\/td>\nTurn-based, with interruption handling<\/td>\nContinuous stream processing, no turns<\/td>\n<\/tr>\n
Tools<\/td>\nFunction calling, Google Search, instructions<\/td>\nTranslation only, no tools or instructions<\/td>\n<\/tr>\n
Inputs<\/td>\nText, audio, video, and image<\/td>\nAudio only, for strict latency<\/td>\n<\/tr>\n
Configuration<\/td>\nGeneration, speech, tools, instructions<\/td>\ntargetLanguageCode<\/code> and echoTargetLanguage<\/code><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/figure>\n
\n

Use Case<\/strong><\/h2>\n

The model targets live interpretation across several settings. Google lists multilingual calls, meetings, lessons, and broadcasts. Developer platforms reduce the integration work for real-time media. Agora, Fishjam, LiveKit, Pipecat, and Vision Agents already use the Live API. These platforms handle the complex real-time media streaming infrastructure. That lets developers focus on the user experience instead.<\/p>\n

Google\u2019s example app demonstrates dubbing and simultaneous multi-language translation. Grab is testing the model for driver-and-traveler communication at pickups. Grab users make over 10 million voice calls per month. CJ ENM, LiveKit, and others reported positive feedback on quality, accuracy, and low latency.<\/p>\n

How It Changes Google Meet and Translate<\/strong><\/h2>\n

According to Google\u2019s official release, Google Meet will soon use 3.5 Live Translate for speech translation. The table shows the stated before-and-after for Meet.<\/p>\n

\n\n\n\n\n\n\n\n
Capability<\/th>\nPrevious Meet<\/th>\nWith 3.5 Live Translate<\/th>\n<\/tr>\n<\/thead>\n
Languages<\/td>\n5<\/td>\n70+<\/td>\n<\/tr>\n
Combinations per meeting<\/td>\nOnly to and from English<\/td>\n2000+ combinations<\/td>\n<\/tr>\n
Access<\/td>\nExisting interface<\/td>\nUpdated interface for instant access<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/figure>\n

The Meet update is in private preview for select business Workspace customers this month. A broader rollout follows later this year. In the Translate app, the Live translate feature works with any connected headphones. It mirrors the speaker\u2019s tone across 70+ languages. Android also gains a listening mode. You hold the phone to your ear like a regular call. The translated audio then streams through the earpiece, without others hearing.<\/p>\n

Key Takeaways<\/strong><\/h2>\n