Expressive captions are part of Live Caption, so they’re built into the operating system and available in all apps on your phone. This means you can use expressive captions with most things you watch, like live streams on social platforms, memories from your Google Photos Reel, and video messages from friends and family. When enabled, subtitles will display in real-time and on-device, so you can use them even when you’re in airplane mode.
Bringing expressive captions to life
To create expressive captions, our Android and Google DeepMind teams worked to understand how we interact with content on our devices without sound. Using multiple AI models, Expressive Captions not only captures spoken words, but also translates them into stylized captions, while providing labels for an even wider range of background sounds. This makes subtitles as dynamic as listening to the audio. This is just one way we build for the real-life experiences of people with disabilities and use AI to build for everyone.
Starting today, expressive captions will be available in the US in English on any Android device running Android 14 and above with Live Caption. This is part of our work to find even more ways to bring emotional expression and context to captions.