Meta Quest Headsets Will Get Artificial Intelligence Next Month
Meta is ahead of Apple in implementing AI in virtual reality. Bloomberg’s Mark Gurman previously reported that Apple Vision Pro will get Apple Intelligence sometime after this year, and Meta Quest headsets will get artificial intelligence next month .
Based on the Meta AI Assistant already built into Ray-Ban smart glasses , Meta AI with Vision on Meta Quest will allow users to ask Meta questions based on what they see using the full-color pass-through cameras on their device. This means it will initially be limited to Quest 3 and Quest Pro devices, although Meta has hinted that eventually the AI will also be able to detect objects visible on the Quest 2’s simpler sensors.
Meta says users can ask AI to help them complete an outfit just by looking at it, and released a video in which the headset was able to identify a dog even as it ran in and out of frame. AI can also answer more general non-visionary questions, such as suggesting good restaurants nearby or helping you remember the most famous quotes from Hamlet . Meta AI can additionally use Bing to search real-time data from the web, so it’s not limited to training data.
Meta AI with Vision relies on multimodal technology, meaning it can accept input from multiple environments and translate content between them. The company recently said it won’t be releasing its next multi-modal model in the EU , so the Quest’s AI features will only be available in Canada and the US at first. They will also only support English.
Despite the limited initial release, the company is going all out with AI, saying that “Meta AI will replace the current voice commands on the Quest.” This means it will also be able to help you control your headset, although to what extent remains to be seen.
Meta AI will first launch on Quest in experimental mode. To try it out when it’s ready, open the headset’s settings menu and turn it on under the Experimental submenu.