US20240273837
2024-08-15
Physics
G06T19/006
The MR service platform is designed to provide a Mixed Reality Automotive Meta Service (MR AMS) that enhances the driving experience by integrating digital twin technology. It consists of a Digital Twin as a Service (DTaaS) server located externally to the vehicle, which facilitates communication with an MR service device installed within the vehicle. This setup allows for real-time data exchange and the delivery of relevant mixed reality content based on the vehicle's location.
The architecture includes several critical components: a DTaaS API for communication, a database for storing digital twin maps and 3D polygon maps, and a processor that manages data transmission. The system processes location information received from the vehicle to send appropriate 3D maps back to the MR service device, enabling users to visualize their surroundings in a mixed reality format.
Users interact with the MR AMS through an interface API within the vehicle, which communicates requests to an external service aggregation manager. This manager retrieves context-specific information from various service providers, ensuring that users receive tailored content that enhances their driving experience. The system can request different types of context based on user needs, providing a seamless blend of real-world and virtual information.
A context manager plays a vital role in handling user requests, parsing them, and generating relevant queries. It works alongside a context interpreter that manages sessions and interacts with a context graph database. This structure allows for efficient retrieval of data models and ensures that users receive accurate and timely information related to their driving environment.
The MR AMS client in the vehicle is responsible for rendering mixed reality visuals using UI data generated from various inputs, including navigation information and UX rules. This client interacts with scene management components to display relevant data effectively. By integrating augmented reality capabilities, the platform aims to enhance user engagement and provide valuable insights while driving.