Meta is pushing its Ray-Ban Meta smart glasses further into AI assistant territory with firmware v11, an update that brings live AI, real-time video understanding, live translation, and Shazam support to eligible owners.
The update is available to Ray-Ban Meta owners in Meta’s early access program for the U.S. and Canada. Its most important change is that Meta AI can now stay in a more continuous conversation with the wearer, including follow-up questions and topic changes without repeatedly using the “Hey, Meta” wakeword.
Live AI makes the glasses more conversational
The new live AI feature is designed around ongoing interaction rather than one-off commands. A wearer can talk with Meta AI, return to something discussed earlier, interrupt the assistant, or move the conversation in a new direction.
That matters because smart glasses are used in moments when hands-free interaction is the point. The update makes Meta AI less dependent on repeated command phrasing and more useful as a continuous assistant that can respond while the wearer is doing something else.
Meta first unveiled live AI this fall. With firmware v11, that capability is now moving from demonstration to early access availability for Ray-Ban Meta owners in the U.S. and Canada program.
Real-time AI video brings the camera into the conversation
Live AI also works with real-time video from the glasses. Wearers can ask Meta AI questions about what they are seeing as they see it, using the front-facing camera on the Ray-Ban Meta glasses as part of the assistant experience.
For example, the source describes a wearer asking about what is around their neighborhood. The important shift is that the assistant is no longer limited to speech-only input or static prompts. It can answer questions based on what is in view of the glasses’ camera.
Real-time AI video was a major focus for Meta at its Connect dev conference early this fall. The feature has been positioned against OpenAI’s Advanced Voice Mode with Vision and Google’s Project Astra, both of which are part of the broader race to make AI assistants respond to the physical world as users experience it.
With Monday’s update, Meta becomes one of the first tech giants to bring real-time AI video to market on smart glasses. Google has said it plans to sell AR glasses with similar capabilities, but it has not committed to a concrete timeline.
Live translation targets everyday conversations
Firmware v11 also adds live translation for Ray-Ban Meta smart glasses. The feature translates real-time speech between English and Spanish, French, or Italian.
When a wearer is speaking with someone using one of those languages, the glasses can play the English translation through their open-ear speakers. A transcript also appears on the paired phone.
The setup shows how Meta is using the glasses as both an audio device and a display-connected companion through the phone. The wearer hears the translation directly, while the phone keeps a written record of what is being said.
The supported language pairs named in the source are specific: English with Spanish, French, or Italian. The article does not state that other languages are included in firmware v11.
Shazam support adds a simple music command
The update is not limited to larger AI assistant features. Ray-Ban Meta also gains Shazam support with firmware v11.
Wearers can say, “Hey, Meta, Shazam this song” to have the glasses try to identify music that is playing. Compared with live AI and live translation, this is a narrower feature, but it fits the same hands-free pattern: the wearer can ask for help without pulling out a phone first.
Together, the firmware v11 additions give Ray-Ban Meta a broader set of everyday assistant functions:
- Ongoing conversations with Meta AI through live AI
- Real-time AI video using the glasses’ front-facing camera
- Live translation between English and Spanish, French, or Italian
- Song identification through Shazam support
Meta is still warning users about accuracy
Meta is also setting expectations for the new AI tools. The company warns that live AI and live translation, in particular, might not always get things right.
“We’re continuing to learn what works best and improving the experience for everyone,”
That warning is important because these features work in real time and may be used in unpredictable settings. Conversations, speech, background sound, and what appears in the camera view can all affect how useful the assistant feels to the wearer.
Meta has also suggested that live AI may eventually provide “useful suggestions” before the wearer asks. The company did not say what those suggestions would be.
The firmware v11 release follows another major Ray-Ban Meta update in November, when Meta began rolling out certain AI capabilities to users of the glasses in France, Italy, and Spain. The product also appears to have commercial momentum: in October, Ray-Ban owner EssilorLuxottica told Upload VR that Ray-Ban Meta was the top-selling glasses brand in 60% of all Ray-Ban stores across Europe, the Middle East, and Africa.
For now, the practical takeaway is clear. Meta is using Ray-Ban Meta smart glasses to move AI assistance closer to real-world, real-time use: seeing what the wearer sees, responding through conversation, translating speech, and handling quick tasks without a phone in hand.