AUGMENTED REALITY DEVICE CAPABLE OF DISPLAYING VIRTUAL KEYBOARD AND OPERATION METHOD THEREOF

Smart overview of the Invention

An augmented reality (AR) device is designed to display a virtual keyboard by intelligently determining the optimal area for overlay based on the real-world environment and keyboard profile information. This involves scanning the surroundings to identify suitable flat surfaces free of obstructions. The device then selects a keyboard type, considering factors like shape, size, and input language, before rendering it onto the chosen area.

Background

AR technology enhances real-world environments by overlaying virtual objects, providing users with a seamless blend of digital and physical worlds. AR devices, such as smart glasses, are increasingly popular for tasks like navigation and information retrieval. Unlike traditional physical or touchscreen keyboards, AR devices can project virtual keyboards onto real-world surfaces, offering input through gestures. However, conventional AR keyboards often suffer from poor visibility and usability when displayed on cluttered surfaces.

Technical Approach

The AR device employs various sensors, including cameras and LiDAR, to scan the environment and identify unobstructed planes suitable for displaying a virtual keyboard. It then determines the appropriate keyboard type based on predefined attributes such as shape and language preferences. The device renders the selected keyboard onto the identified area, ensuring optimal visibility and user interaction.

Implementation

The system architecture includes components like cameras and sensors for environmental scanning, a memory for storing instructions, and processors for executing these instructions. The software ensures that upon execution, the device identifies suitable areas for keyboard overlay and performs the necessary rendering. This approach allows for dynamic adaptation to varying environmental contexts.

Illustrations and Examples

The patent application provides diagrams illustrating various scenarios of virtual keyboard deployment. These include different types of keyboards such as QWERTY or numeric keypads displayed on diverse surfaces. Flowcharts detail methods for detecting areas, choosing keyboard types, and adapting display settings based on user gestures or environmental colors. These examples underscore the versatility and user-centric design of the AR device.