Quest Developers Will Finally Get Access to Cameras, Promising New Wave of “cutting-edge” Mixed Reality

Developers have long been frustrated by the lack of access to Quest’s cameras for creating mixed reality content. However, there’s good news on the horizon.

During Connect this week, Meta VP of VR/AR Mark Rabkin revealed that a new camera Passthrough API will be available to developers early next year. This release is expected to open up a world of possibilities for cutting-edge MR experiences, including tracked objects, AI applications, fancy overlays, scene understanding, and more.

Testing for the Passthrough API is set to begin very soon, with select developers possibly getting access to a beta version for their games.

Currently, developers have had to rely on alternative methods like geometric representations and tracking data due to the lack of camera access. With greater camera access, developers will have more control over user space, allowing for more immersive experiences.

However, with this increased access comes the need for tighter privacy controls. Meta will need to address concerns about user privacy as they roll out the Passthrough API. The company has also announced updates to Horizon OS to enhance privacy settings, including indicators for when apps are using the microphone, location, and spatial data, as well as a sensor lock feature for added security.