“Embodiments of a mixed reality system are described that may include a mixed reality device such as a headset, helmet, goggles, or glasses (referred to herein as a head-mounted display (HMD) that includes a projector mechanism for projecting or displaying frames including left and right images to a user’s eyes to thus provide 3D virtual views to the user. The 3D virtual views may include views of the user’s environment augmented with virtual content (e.g., virtual objects, virtual tags, etc.). The mixed reality system may include world-facing sensors that collect information about the user’s environment (e.g., video, depth information, lighting information, etc.), and user-facing sensors that collect information about the user (e.g., the user’s expressions, eye movement, hand gestures, etc.). The sensors provide the information as inputs to a controller of the mixed reality system. The controller may render frames including virtual content based at least in part on the inputs from the world and user sensors. The controller may be integrated in the HMD, or alternatively may be implemented at least in part by a device external to the HMD. The HMD may display the frames generated by the controller to provide a 3D virtual view including the virtual content and a view of the user’s environment for viewing by the user.”-Summary from Apple’s patent application