SMART DIGITAL INTERACTIONS WITH AUGMENTED REALITY AND GENERATIVE ARTIFICIAL INTELLIGENCE

Smart overview of the Invention

The patent application describes systems, methods, and devices designed to facilitate smart digital interactions using augmented reality (AR) and generative artificial intelligence (AI). The core method involves authenticating a user through a premises computing system, which allows access to specific user data records. User input is monitored via an input device, and a request is sent to a generative AI system to generate a response based on this input. The generated response is then visualized using an AR device.

Authentication and User Input

A significant aspect of the method is user authentication, which can be enhanced through wireless communication from the user's mobile device. Once authenticated, the system processes user inputs, which may include audio data. This input is monitored and processed using technologies such as text-to-speech models, enabling real-time interaction with the generative AI system. The AI system generates responses that are subsequently transformed into visualizations for the user.

Remote User Interaction

The system also supports interactions with remote users. It can authenticate remote users via their computing systems and share visualizations accordingly. The authentication settings determine which subsets of user data can be accessed or shared with these remote users, ensuring secure and controlled information distribution.

Visualization and Data Management

Visualizations generated by the AI system are based on templates included in its responses. These visualizations can be enhanced with additional data retrieved from primary computing systems as directed by the AI's instructions. The premises computing system can also provide video streams to complement these visualizations for remote display, further enriching the interaction experience.

System Configuration

The described system comprises a premises computing system equipped with processors and memory capable of executing the outlined methods. The system ensures secure user authentication, monitors inputs, and manages data access requests. It effectively integrates AR and AI technologies to deliver dynamic and interactive visual experiences, facilitated by a non-transitory computer-readable medium containing necessary instructions for implementation.