Meta Connect 2024: A Focus on AI and the Metaverse

Meta Connect 2024, a developer-focused event, featured a keynote address by CEO Mark Zuckerberg, who highlighted new hardware and software designed to bolster Meta's two core ambitions: AI and the metaverse.

• The event showcased new Quest headsets, including the Quest 3S, a more affordable alternative to the Quest 3.
• Updates to Meta's Llama AI model, including a multimodal version capable of understanding and responding to charts and graphs, were announced.
• Meta unveiled Orion, its first consumer full holographic AR glasses, which are still in the early stages of development.

Meta's Quest 3S: A Cheaper Mixed Reality Option

Meta Connect 2024 saw the launch of the Quest 3S, a more budget-friendly option for users seeking a mixed reality experience. The Quest 3S is fully wireless, offering access to the existing library of Quest applications and games.

• It starts at $299 for the 128GB version and $399 for the 256GB version, making it more accessible than the Quest 3.
• The release of the Quest 3S led to a price reduction for the Quest 3, now available for $499.
• Meta has discontinued the Quest 2 and Quest Pro, with sales continuing until the end of the year or until stock is depleted.

Meta AI Gains a Voice

Meta's AI has developed a voice, allowing users to interact with it verbally through various platforms, including Messenger, Facebook, WhatsApp, and Instagram.

• Users can ask questions or engage in conversations with Meta AI, receiving vocal responses.
• Meta AI offers multiple voice options, including those of celebrities like Dame Judi Dench, John Cena, Awkwafina, Kristen Bell, and Keegan-Michael Key.
• Meta AI now boasts 500 million users.

Llama 3.2: Multimodal AI Capabilities

Meta's Llama family of AI models has progressed to version 3.2, introducing multimodal capabilities to several of its models.

• Llama 3.2 11B and 90B can now understand and interpret charts and graphs, caption images, and identify objects within pictures based on descriptions.
• Llama 3.2 11B and 90B are not available in Europe due to the EU's AI Act restrictions, limiting the availability of certain features like image analysis for users in the region.

Meta's Ray-Ban Smart Glasses: New AI Features

Meta continues its efforts to make Ray-Ban smart glasses a mainstream consumer device, introducing new AI-powered features.

• Real-time AI video processing allows users to ask the glasses questions about what they are seeing, receiving responses from the AI.
• Smart glasses are equipped with reminder features similar to smartphones.
• Live language translation is now available for English, French, Italian, and Spanish.
• The glasses offer full integration with popular music streaming services like Amazon Music, Audible, and iHeart Radio.

Orion: Meta's Vision for the Future of AR

Zuckerberg made a surprise announcement at Meta Connect 2024, revealing Orion, Meta's "first consumer full holographic AR glasses." While not available for immediate purchase, Orion showcases Meta's vision for the future of AR.

• Orion is lightweight and boasts hand-tracking and eye-tracking capabilities.
• The most ambitious feature of Orion is its neural interface, which is still in its early stages of development.
• Zuckerberg shared that Orion has garnered positive feedback from early testers, including Nvidia CEO Jensen Huang.

Meta's AI Integration into Facebook and Instagram

Meta has been incorporating AI into its platforms, including Facebook and Instagram, in various ways, both visible and behind the scenes.

• Facebook is introducing a feature that uses AI to generate content it believes users will be interested in sharing or engaging with.
• Meta has also been experimenting with using AI for translation and dubbing creator content, currently focused on videos made in the U.S. and Latin America, translating between English and Spanish.

Meta's Focus on Developers

Meta Connect 2024 focused on fostering relationships with developers, encouraging them to build and contribute to the Quest app ecosystem.

• Meta released support for Android apps on the Quest, along with support for 3D and spatial applications.
• The event showcased new experiences for the Quest ecosystem, including Batman: Arkham Shadow, Alien: Rogue Incursion, a remake of Arizona Sunshine, and a VR version of Wordle.