US20250316032
2025-10-09
Physics
G06T19/006
The patent application discusses a novel user interface for extended reality (XR) experiences, integrating live feeds from external sensors. The interface is designed to operate within a three-dimensional environment, providing users with enhanced interaction capabilities. It incorporates various features such as displaying a widget dashboard, live camera feeds, and stereoscopic views with special effects. The system is capable of suggesting camera poses and allows for virtual annotation of objects.
The system displays representations of physical tools to guide users by indicating their location relative to video feeds. It can suggest changes to camera poses based on previously detected image data. Users can interact with the interface by rotating and viewing 3D models of objects from different angles and depths. The interface also allows live scrubbing through image data as the camera's position changes relative to a physical object.
This technology is applicable in various fields, including engineering and medical operations. In surgical contexts, it provides camera-guided assistance, enhancing precision during procedures. Beyond medical applications, the system can be utilized in engineering tasks where camera guidance is critical, such as in manufacturing or fabrication operations.
Illustrated in the application is an electronic device that could be a head-mounted display or similar wearable technology. This device includes both internal and external sensors for capturing user interactions and environmental data. Internal sensors are used for eye-tracking, while external sensors capture the surrounding physical environment and user movements.
The device features a display that can show augmented reality elements overlaid on the user's view of the real world. It can present virtual objects in an XR environment, allowing users to see digital elements integrated into their physical space. This capability is enhanced by the device's ability to detect surfaces and adjust the display of virtual objects accordingly.