DISPLAY DEVICE FOR PROVIDING VIRTUAL OBJECT THROUGH MIRROR DISPLAY AND CONTROL METHOD THEREOF

Smart overview of the Invention

The patent application discusses a display device that integrates a mirror display with a depth camera, memory, and processors to provide an interactive experience. The device captures images of objects reflected in the mirror and processes these images to obtain depth, skeleton, and shape information. This data is used to match and display virtual objects in a manner that aligns with the physical objects, enhancing the realism of the virtual interaction.

Technological Context

This innovation addresses the limitations of conventional mirror displays, which often fail to realistically integrate virtual objects with user reflections. Traditional systems struggle with issues like virtual objects overlapping or penetrating user images. The proposed system aims to overcome these challenges by accurately identifying and displaying virtual objects as if they exist in the same space as the user, offering an improved immersive experience.

Functional Components

The system relies on a depth camera to capture images and obtain depth information of the reflected objects. This information is processed to derive skeleton and shape details, which are crucial for accurately matching virtual objects to their real-world counterparts. The device's processors execute instructions that enable these functionalities, ensuring the virtual object is displayed in a coherent and interactive manner.

Interactive Features

The display device supports interaction with virtual objects through user inputs, such as touch. It can adjust the position, size, and orientation of virtual objects based on user commands. Additionally, it can communicate with external devices to receive or transmit virtual shape information, enhancing the interactive capabilities and allowing for tactile feedback when the virtual object contacts the user.

Advanced Processing

A neural network model is utilized to refine the shape information of objects, incorporating depth data from multiple viewpoints. This advanced processing enables the system to create a dynamic and responsive interaction between real and virtual elements, significantly enhancing the user's experience. The system's ability to adjust virtual object parameters based on user inputs further exemplifies its adaptability and sophistication.