METHOD, DEVICE, AND SYSTEM FOR PROCESSING AND DISPLAYING ULTRA-REALISTIC VIDEO CONTENT AND STEREOSCOPIC IMAGES CAPABLE OF XR INTERACTION BETWEEN USERS

Smart overview of the Invention

The patent application outlines a method and device for creating and displaying interactive 3D content tailored to users' physical or cognitive abilities. This involves collecting data from sensors attached to the user's body, analyzing this data to understand the user's movements and capabilities, and using an AI model to adjust the level or difficulty of the 3D content accordingly. The customized content is then displayed on a head-mounted display, allowing users to interact with ultra-realistic images in a three-dimensional space.

Technical Field

This technology pertains to image processing that facilitates interaction between realistic image contents. It specifically focuses on generating personalized content based on the user's physical or cognitive abilities and presenting it in real-time within a three-dimensional environment. This approach aims to enhance user experience by adapting the content to individual capabilities, thus enabling a more immersive and realistic interaction with 3D images.

Background

The advancement of augmented reality (AR) and virtual reality (VR) technologies has spurred interest in 3D content that can accurately represent objects with depth and parallax. Holographic AR displays, in particular, offer solutions to common issues like eye strain by aligning accommodation and convergence. This technology reproduces objects in three dimensions, creating a visual experience as if the object is physically present, which is crucial for realistic interaction.

Summary of Invention

The solution involves a method for generating 3D data suitable for XR or holographic AR terminals. It includes processing sensor data from the user's body to derive feature data related to movement and physical ability. An AI model uses this data to determine appropriate content levels, which are then adjusted for difficulty before being uploaded to the user's display device. The system also corrects hologram data based on display terminal specifications, ensuring optimal presentation.

Detailed Description

The invention allows for modifications and different embodiments while maintaining its core functionality. It includes steps like obtaining color images and depth maps for objects, preprocessing these into 3D data, generating hologram data, and correcting it based on terminal information. This flexibility ensures that the technology can be adapted across various devices and user needs without compromising its effectiveness in delivering realistic 3D experiences.