US20250061671
2025-02-20
Physics
G06T19/20
The invention integrates augmented reality (AR), virtual reality (VR), and photogrammetry to enhance interactions with the physical world. Through various imaging techniques, such as drones and satellite imaging, a three-dimensional (3D) model of the real world is constructed. Users can experience this virtual environment via computing systems or VR interfaces. They can create annotations like voice recordings, images, and text within this virtual model, which are connected to the physical world using a coordinate system. This setup allows AR explorers and VR users to interact through geographically aligned AR and VR models.
This innovation pertains to electronics and artificial intelligence, specifically focusing on a feedback loop that combines AR and VR to facilitate interactions between the virtual and physical worlds. Current AR and VR technologies offer collaboration but lack shared annotations and a feedback loop between AR and VR users. This invention addresses these gaps by providing an improved system for combined AR and VR environments.
Embodiments include a computer-implemented method that uses an AR application to display annotations linked to real-world locations as holographic projections. These annotations are also associated with corresponding locations in a VR application. The invention also includes a non-transitory computer-readable medium storing a program for providing AR with a feedback loop, enabling annotations visible in both AR and VR applications. Annotations can include various forms such as voice recordings, images, and text.
Users can interact with annotations in multiple ways, creating a communication loop between virtual (VR) users and real (AR) world explorers. Explorers can leave text memos, voice recordings, or videos on annotations in the virtual world. As more data is generated from the physical world, it is processed for analysis by virtual users who then update the data for explorers. The system allows for collaborative work between AR and VR users by aligning the virtual and real worlds.
The AR user interface offers tools for real-world exploration, such as a toggleable map showing locations of features and annotations. Annotations appear as pins on a 3D map, color-coded to indicate their status. Holograms representing annotations vary in size based on distance from the explorer, aiding navigation through features like a compass or 3D arrows guiding them to annotation locations. Multiple annotations can be linked as waypoints for sequential exploration.