MIXED REALITY INTERACTION WITH EYE-TRACKING TECHNIQUES

Smart overview of the Invention

Mixed reality (MR) interactions utilize eye tracking to determine user gaze, combined with various secondary inputs like finger and hand gestures. This allows for the identification of locations of interest within displayed content based on the user's gaze and actions such as zooming or rotating. The integration of these inputs enhances user engagement and interaction with virtual environments, making the experience more intuitive.

Technical Field and Background

This technology pertains to near-eye display devices that facilitate user interaction through eye tracking. Recent advancements in interactive content, including virtual reality (VR) and augmented reality (AR), have increased the demand for effective wearable display systems. Head-mounted displays (HMDs) are examples of such systems, enabling users to view both real and virtual objects simultaneously while using their gaze as an input method.

Eye Tracking Techniques

Eye tracking can be achieved through various techniques, such as fringe projection and time-of-flight analysis. These methods involve projecting light onto the eye and capturing the reflection to determine gaze direction and position. By integrating eye tracking with secondary input methods, a near-eye display device can enhance user interactions within 3D environments, allowing for more dynamic control over displayed content.

System Components and Functionality

The system includes a near-eye display that may be a head-mounted display or glasses, connected to external imaging devices or input interfaces. It is designed to improve aspects like image quality, field of view, and power efficiency. The combination of real-world imagery with digital content creates an augmented reality experience, enabling users to interact seamlessly with both their environment and virtual elements.