Devices, Methods, and Graphical User Interfaces for Providing Computer-Generated Experiences

Smart overview of the Invention

This patent application describes a computing system designed to enhance user interaction with computer-generated environments, such as virtual reality (VR) and mixed reality (MR). The system includes two display generation components that work together to provide an immersive experience while also conveying status information about the user's engagement. The first display shows the computer-generated environment, and the second display provides visual cues about the user's status and the environment's content.

Technical Field

The invention operates within the realm of computing systems equipped with various input devices to facilitate VR and MR experiences. These systems utilize displays, cameras, and sensors to allow users to interact with augmented environments. The invention aims to address inefficiencies in current interfaces by making user interactions more intuitive and less cumbersome, ultimately enhancing the virtual experience.

Background

Current systems for augmented reality often present challenges such as complex interfaces that require multiple inputs for simple tasks, leading to user frustration and energy inefficiency. These systems can also isolate users from their physical surroundings, hindering social interactions. The invention seeks to mitigate these issues by providing more intuitive interfaces that reduce cognitive load and improve social connectivity during virtual experiences.

Solution

The proposed system enhances user interaction through improved methods and interfaces that reduce unnecessary inputs and enhance understanding between user actions and system responses. This is achieved by using dual displays: one for immersive content and another for status updates visible to others in the user's environment. This setup allows for better social interaction by providing cues about the user's availability or level of engagement in the virtual environment.

Implementation

The system can be integrated into various devices, including desktop computers, portable devices, and wearables like head-mounted displays (HMDs). It uses a combination of touch-sensitive surfaces, eye-tracking, hand-tracking, and voice inputs to facilitate user interaction. The outward-facing display can show contextual information based on the user's current engagement level, reducing unnecessary steps to access desired content. This not only improves user experience but also conserves battery life by minimizing unnecessary activation of full virtual experiences.