AR DEVICE AND METHOD FOR CONTROLLING AR DEVICE

Smart overview of the Invention

The patent application describes an augmented reality (AR) device designed to enhance user interaction within virtual environments such as the metaverse. The device incorporates several advanced input technologies to facilitate accurate and efficient text entry. Key components include a voice pickup sensor, an eye tracking unit, a lip shape tracking unit, and an autocompletion unit. These features aim to improve the precision of text input, especially in environments where silence is required.

Technical Field and Background

The AR device is positioned within the context of the burgeoning metaverse, a virtual space where users can interact socially and economically. As the metaverse expands, there is a growing demand for devices that offer seamless interaction capabilities. This AR device addresses the need for efficient text input methods, crucial for communication in virtual spaces. The device is particularly relevant as metaverse applications transition to mobile platforms, necessitating lightweight and high-quality optical systems.

Technical Solutions

The AR device utilizes a combination of sensors and tracking units to facilitate text input. The voice pickup sensor detects letters through bone conduction at the skull-jaw joint, while the eye tracking unit monitors eye movements via a camera. Additionally, a lip shape tracking unit uses infrared technology to infer letters based on observed lip movements. An autocompletion unit then completes words based on these inferred letters, enhancing overall input speed and accuracy.

Advantages

This innovative approach offers several advantages. It allows for precise text input in silent environments and reduces the time required for users to enter text due to its error correction and autocompletion features. By integrating these advanced technologies, the AR device provides an efficient interface for users interacting in virtual spaces, making it particularly suitable for office environments and social networking services.

Illustrations and Implementation

The patent includes diagrams illustrating various embodiments of the AR device, such as head-mounted displays (HMDs) and AR glasses. These diagrams show the arrangement of sensors and tracking units within the device. Further illustrations detail how these components work together to achieve accurate text input. The application also outlines potential modifications and adaptations of these technologies, emphasizing their flexibility and applicability across different use cases.