PASSTHROUGH VIEWING OF REAL-WORLD ENVIRONMENT FOR EXTENDED REALITY HEADSET TO SUPPORT USER SAFETY AND IMMERSION

Smart overview of the Invention

The described method involves capturing real-time video using imaging sensors on an immersive headset. This video is processed to identify and render real-world objects onto the headset's display. Users can select specific objects or spatial volumes that contain these objects, allowing for an interactive experience. The system overlays these real-world elements onto an extended reality (XR) view, offering multiple display modes to enhance user immersion and safety.

Technical Field

The application pertains to extended reality (XR) systems, focusing on integrating real-world environments into XR headsets. This integration aims to maintain user safety while enhancing the immersive experience by allowing users to perceive and interact with their physical surroundings within a digital context.

Background

Recent advancements in virtual reality (VR) and XR technologies have led to highly immersive digital environments. However, these environments often isolate users from their physical surroundings, posing potential safety risks. The ability to blend real-world elements into XR experiences addresses these concerns by maintaining user awareness of their environment.

Embodiments

• First Embodiment: A method for capturing and processing video to render real-world objects on a headset display, allowing user interaction with selected objects or volumes.
• Second Embodiment: An electronic device equipped with imaging sensors and processing capabilities to execute the described method, enhancing user interaction with real-world elements.
• Third Embodiment: A non-transitory machine-readable medium containing instructions for executing the video capture, processing, and rendering tasks, facilitating the integration of real-world objects into XR experiences.

Additional Features

The application includes various technical features that may be apparent to skilled practitioners. It emphasizes definitions and interpretations of terms used throughout the document, ensuring clarity in describing the scope and functionality of the invention. The described technology supports both hardware and software implementations, broadening its applicability across different XR systems.