Meta has just unveiled that its Ray-Ban Meta smart glasses now feature multimodal capabilities, incorporating AI technologies that are able to understand and interact with the user’s environment. This is because Meta AI that powers these AR glasses is now based on Llama 3, which boasts multimodal features.
The feature has been in early access to a limited number of users including tech reviewers, but it is now rolling out to everyone with access to the Meta smart glasses.
Previously, Meta’s AI assistant was confined to audio-based tasks. Now, it can analyze visual data captured by the glasses’ integrated camera, providing pertinent insights based on what it sees.
The glasses now allow users to translate text, identify objects, or access other relevant information entirely hands-free. Additionally, wearers have the ability to share their perspectives during video calls on WhatsApp and Messenger, offering a hands-free method to share experiences in real-time.
The video below from YouTube Marques Brownlee shows what the AR glasses are now capable of.
This multimodal AI enhancement is being rolled out as a beta feature to all users in the US and Canada. The glasses will be available in hundreds of different custom frame and lens combinations to choose from, allowing users to pick exactly what they’re looking for. This can be found on the Ray-Ban Remix platform.
Other than that, there is also an exclusive Scuderia Ferrari colorway for Miami 2024. This version is supposed to “bring together the legacy of Ferrari, timeless Ray-Ban design, and cutting-edge tech from Meta, available April 24, 2024.”
The blog post from Meta says: “Our new styles are designed to be prescription lens compatible. Skyler and the new Headliner low bridge fit are available for pre-order now. These new styles are available in 15 countries, including the US, Canada, Australia, and throughout Europe.”
Meta’s latest update to its smart glasses signifies a significant advancement, turning the stylish wearables into powerful, context-aware assistants. Equally crucial are the iconic Ray-Ban frames, which incorporate technology so discreet it’s almost invisible—a key element for widespread acceptance.
