Meta's Ray-Ban Smart Glasses Gain AI To See And Identify Everything You See

hero rbm plp sunglasses
Meta just upgraded its Ray-Ban-collaborated smart glasses with a multimodal AI (artificial intelligence) that can identify and act on what you're seeing. The system is available via a US-only early access program currently with early signs pointing to something quite a bit more useful than Ray-Ban Stories back in 2021.

Meta chief technology officer Andrew "Boz" Bosworth dropped a video post on Instagram lauding a new multimodal AI upgrade to its second-generation Ray-Ban smart glasses. The new Meta AI is slated for public launch in 2024, but that hasn't stopped Boz from raving about the AI assistant's ability to help you find and use information that you see through the glasses.

Screenshot 2023 12 12 at 5 51 14 PM
Demo of Meta AI on Ray-Ban smart glasses (Credit: Instagram)

In the post, Boz shows off a video of him looking at a piece of wall art with what could be the AI UI (say that five times really fast). The Meta AI responded to Boz's question "Look and tell me what you see" by stating that the wall art as "a wooden sculpture of the state of California with LED lights installed on it." Going one step further, AI describes the piece as "beautiful". It probably won't say the same if it was a picture of yours truly.

At the moment, operating these glasses is completely done by voice via an initial hotword "Hey Meta," followed by an open ended question or command. This would be similar to someone using a standard Amazon Alexa or Google Assistant, but with a more open and fluid conversation pattern. The glasses will then combine what it sees with the onboard cameras with the spoken command into an AI-generated response or action.

Ray Ban Meta Smart Glasses   Transparent Group Shot

The concept behind Meta's AI (and for that matter, GPT-4V) is basically taking various image, text, speech, and numerical data combined with multiple intelligence processing algorithms to achieve higher performances. While wearables with generative AI is not new, they're as rare as hen's teeth, so it's awesome to see Meta continue to push forward in this area.