CONTROLLING INTERACTIVE FASHION BASED ON BODY GESTURES

Smart overview of the Invention

Methods and systems are designed to enhance interactive fashion experiences by integrating augmented reality (AR) with body gestures. The process starts with receiving a video of a person wearing a fashion item, followed by segmenting the item from the video feed. By detecting gestures made by the individual, the AR elements applied to the fashion item can be modified in real-time, creating a dynamic interaction between the user and the augmented visuals.

Augmented Reality in Fashion

Augmented reality enriches the user's experience by overlaying virtual objects onto their real-world environment. Unlike virtual reality, which immerses users entirely in a digital realm, AR allows for interaction with both real and virtual elements. This technology finds applications in various fields, including gaming and messaging, making it versatile and engaging.

Advancements Over Existing Systems

Current AR systems often rely on depth sensors to modify images, which can complicate device design and increase costs. The proposed methods eliminate this dependency by using machine learning techniques to segment clothing items and detect user gestures without requiring additional hardware. This innovation addresses limitations seen in existing systems that struggle with full-body recognition or multi-user scenarios.

Gesture-Based Interaction

The technology allows for various visual effects on clothing based on user gestures, such as changing colors or displaying animations. For instance, a user's hand movement can alter the appearance of their shirt or trigger specific actions associated with augmented elements. This intuitive interaction enhances user engagement and provides a more immersive experience.

Network Integration

The system operates within a networked messaging environment, facilitating data exchange between client devices and servers. Each device runs a messaging application that communicates with others over the internet, enabling seamless sharing of AR content. This connectivity fosters an interactive platform where users can experience augmented fashion dynamically while communicating with peers.