MIXED-REALITY COMMUNICATION METHOD, COMMUNICATION SYSTEM, COMPUTER PROGRAM, AND INFORMATION MEDIUM

Smart overview of the Invention

A communication method facilitates interaction between two users utilizing mixed-reality terminals over a network. The first user transmits a virtual character and objects representing themselves and a real object to the second user's terminal. The second user can modify a duplicate of the virtual object, enhancing collaborative experiences in remote settings.

Technical Background

Traditional mixed-reality tools often limit interpersonal communication by providing only a first-person view, which hinders the ability to see facial expressions. Existing systems like HoloLens™ and Mesh™ allow for avatar creation and holoportation but lack effective manipulation of real objects. This innovation aims to improve remote communication by allowing users to interact with both virtual and real objects seamlessly.

Aims of the Development

The primary objectives are to enhance remote communication and enable effective training related to object manipulation. By allowing one user to interact with a virtual representation of a real object, the method creates an engaging learning environment, akin to physical presence.

Functional Features

• The first terminal captures data from the first user and a real object, generating corresponding virtual characters and objects.
• The second terminal can manipulate these virtual representations, providing an interactive training experience.
• Real-time data transmission allows users to observe each other's actions, improving learning outcomes.

System Components

The communication system comprises multiple terminals connected via a network, capable of exchanging both visual and audio data. Each terminal incorporates sensors and headsets that facilitate the capture and projection of holographic images, enabling immersive interactions. This setup supports various user roles, allowing flexibility in training scenarios.