US20250330677
2025-10-23
Electricity
H04N21/4662
The disclosed method focuses on creating automations for interactions among multiple electronic devices, particularly in the context of Internet of Things (IoT) environments. It involves receiving user inputs that express specific intents, and utilizing a generative model to translate these into a sequence of activities. The system identifies necessary entities and predicts an execution plan, which includes automations across various devices. These automations are mapped to specific devices and triggered in sequence based on event occurrences, enhancing user experience in both real and virtual environments.
Existing solutions for IoT device interactions often fall short in terms of complexity and user expectations. Users typically own multiple IoT devices designed for specific tasks, yet conventional systems struggle with dynamic, context-aware operations. For example, when planning an interactive ambiance for events like birthday parties or immersive movie experiences, users face challenges due to the lack of seamless integration and execution support from current systems. The demand for sophisticated orchestration among diverse devices remains unmet, leading to a need for more advanced solutions.
The proposed system addresses these shortcomings by leveraging a pre-trained generative model that processes user inputs to generate a list of relevant activities. It then identifies the entities required to perform these activities and predicts an execution plan. This plan outlines the automations necessary for each activity, considering the relationships between activities and entities. By mapping devices to entities based on this plan, the system ensures that automations are triggered effectively and in sequence as events occur.
The system comprises at least one processor and a memory that work together to execute the aforementioned method. The processor receives user inputs, utilizes the generative model to generate activity lists and identify necessary entities, predicts execution plans, and maps devices accordingly. Commands are then transmitted to the appropriate devices based on this mapping, enabling seamless automation across multiple devices in response to user queries.
This advanced approach facilitates AI-based assistance in orchestrating complex IoT device interactions. It allows users to request tasks through simple queries, which are then processed to identify necessary activities and devices. An execution plan is generated to specify activation times and operational methods, ensuring efficient task execution. By overcoming current limitations, this system enhances the ability to create diverse, immersive experiences across real and virtual environments using IoT technology.