Snap announces collaboration with OpenAI to develop standalone AR glasses Spectacles

2024-09-18

Snap announced on Tuesday the launch of its fifth-generation augmented reality (AR) glasses, Spectacles. This new wearable device aims to combine digital content with the real world, offering voice-controlled AR filters and integration with OpenAI's multimodal AI model. The latest Spectacles can overlay AR effects in the user's surrounding environment and can be controlled through voice commands and gestures. Wearers can generate AI images as AR filters or interact with Snap's AI chatbot, MyAI, to obtain information about objects in their line of sight. Despite showing great potential, Snap's new Spectacles face several challenges in the mainstream market. They weigh 226 grams (about 0.5 pounds), much heavier than competitors like Meta's Ray-Ban smart glasses. The battery life is also limited, lasting only 45 minutes with continuous use. Snap initially focused on developers rather than consumers. The company sells Spectacles through its developer program, priced at $99 per month and requiring a minimum 12-month contract. This strategy aims to establish a strong application ecosystem before targeting a broader consumer market. The glasses come with multiple built-in applications, including rhythm-based games, a golf simulator, and virtual pet experiences. Snap has also partnered with companies such as LEGO Group, ILM Immersive from Lucasfilm, and Niantic to create custom AR experiences for the platform. Spectacles run on Snap OS, a new operating system designed specifically for AR interactions. The device is equipped with four cameras for spatial awareness and hand tracking, as well as a perspective display that automatically adjusts to ambient lighting conditions. Snap's partnership with OpenAI, rumored since last fall, has now been confirmed. This collaboration allows developers to integrate advanced AI models into Spectacles applications, potentially enhancing wearers' contextual understanding of their environment. Currently, this program is only available in the United States and has limited availability. This highlights Snap's focus on building a strong developer ecosystem to drive innovation and create compelling AR experiences for Spectacles.