US20240404218
2024-12-05
Physics
G06T19/006
An augmented reality (AR) system integrates a head-mounted display (HMD) and a handheld computing device (HCD) to enhance the user's experience in a surrounding environment. This system allows digital content to be displayed on both devices simultaneously or modified on one device based on inputs from the other. The HCD can be positioned by the user outside of the HMD's lens view, providing an extended field of view.
The AR system comprises an HMD with a transparent lens for viewing digital content and a set of sensors for detecting user actions or conditions. The HCD, which could be a smartphone, tablet, or laptop, includes its own display and sensors. A control module connects the HMD and HCD, enabling them to interact based on user inputs like gestures, voice commands, or device movements.
User actions that the system can detect include head movements, eye tracking, hand gestures, voice commands, and touchscreen interactions. The control module processes these inputs to modify digital content on either the HMD or HCD. It can also synchronize changes across both devices or allow independent modifications.
The AR system supports adding new digital content to the HCD display, which can be mirrored on the HMD lens or kept separate. Users can utilize applications on the HCD for content processing. Communication between devices is facilitated through local connections or a server.
This AR system addresses limitations in traditional AR setups by expanding the field of view and enhancing control capabilities. It applies to various realities including virtual, mixed, and extended reality environments. The integration of HMD and HCD offers improved functionality compared to previous technologies.