Meta is expanding what its Ray-Ban Meta smart glasses can do, moving them closer to a device that can respond to the world in front of the wearer rather than simply capture it. At Meta Connect 2024 on Wednesday, Meta CEO Mark Zuckerberg announced a set of updates that mix new AI abilities with everyday features people already use on smartphones.
The additions are expected later this year and include real-time AI video processing, live language translation, reminders, QR code scanning, audio integrations, and new Transitions lenses. Together, they show Meta continuing to argue that smart glasses can become a major consumer device category.
Real-time AI video is the central upgrade
The biggest change is the planned addition of real-time AI video capabilities. Today, Ray-Ban Meta glasses can take a picture and then describe that image or answer questions about it. The new version is meant to let users ask questions about what they are seeing while the scene is still unfolding.
Meta AI would then answer verbally in real time. That shift matters because it changes the interaction from a still-image query into a more natural exchange about live surroundings. In the source demo, people asked Ray-Ban Meta questions about a meal they were cooking and about city scenes in front of them.
The feature is described as multimodal because the glasses are using visual information and spoken interaction together. If it works as presented, a wearer could look at an activity, ask a question, and hear an answer without first stopping to capture and review a single photo.
That is also the part that remains hardest to judge before release. The source notes that this is easier said than done, and that speed and smoothness will need to be tested in practice. Google and OpenAI have shown demonstrations of similar real-time AI video capabilities, but Meta would be the first to launch such features in a consumer product.
Live translation brings conversations into focus
Zuckerberg also announced live language translation for Ray-Ban Meta. The feature is designed for English-speaking users talking with someone speaking French, Italian, or Spanish. The glasses should translate what the other person says into the user's language of choice.
Meta says the translation feature is coming later this year and will include more language later on. The initial language set is limited, but the direction is clear: Meta wants the glasses to act as a conversational layer, not just a camera or audio accessory.
That is an important distinction for smart glasses. A phone can already handle many translation tasks, but glasses sit closer to the user's point of view and listening experience. The practical promise is a more immediate interaction, where the user does not need to keep looking down at a separate screen while speaking with someone.
Familiar phone features are coming to the glasses
Not every update is a new AI showcase. Several of the announced features bring established smartphone habits into Ray-Ban Meta smart glasses. That includes reminders, QR code scanning, phone number scanning, and more audio options.
Reminders will let people ask Meta AI to remember things they are looking at through the glasses. In a demo, a user asked the glasses to remember a jacket so the image could be shared with a friend later on. The feature connects the camera, AI assistant, and memory-style task into one flow.
QR code scanning and phone number scanning also move a common phone action into the glasses. Users will be able to ask the glasses to scan something. When a QR code is scanned, it will immediately open on the person's phone with no further action required.
The source article also lists new integrations with Amazon Music, Audible, and iHeart. These are meant to make it easier for people to listen through the glasses' built-in speakers using the streaming service they prefer.
- Reminders: Ask Meta AI to remember something visible through the glasses.
- QR code scanning: Ask the glasses to scan, then open the result on the phone.
- Phone number scanning: Capture phone numbers through the glasses.
- Audio integrations: Use Amazon Music, Audible, and iHeart through the glasses' built-in speakers.
New lenses support everyday wear
Meta also announced that the smart glasses will be available with a range of new Transitions lenses. These lenses respond to ultraviolet light and adjust to the brightness of the room the wearer is in.
That update is less about AI and more about making the glasses practical across changing environments. For a device that Meta wants people to wear regularly, lens flexibility is part of the broader product argument. The more the glasses behave like everyday eyewear, the easier it is for Meta to present them as a consumer device rather than a standalone gadget.
What the updates signal
The Ray-Ban Meta update package combines two ideas. One is ambitious: real-time AI video and live translation suggest a future where smart glasses can interpret and respond to the world as the user experiences it. The other is familiar: reminders, QR scanning, phone number scanning, and audio integrations bring common phone tasks closer to the face.
That mix is deliberate. Advanced AI features may draw attention, but familiar utilities can make the device useful in ordinary moments. Meta's case is that smart glasses can become more than a camera on the face if they can handle both live context and routine tasks.
The key test will be how these features perform once they arrive later this year. Real-time video answers need to feel quick enough to be useful, live translation needs to fit into conversation, and phone-style actions need to be easier through glasses than through a handset. For now, Meta has set out the next stage of Ray-Ban Meta smart glasses as a blend of AI assistant, audio device, camera, and everyday shortcut.