Three-Dimensional Modeling Inside a Virtual Video Conferencing Environment with a Navigable Avatar, and Applications Thereof

Smart overview of the Invention

The patent application describes a web-based videoconference system that integrates navigable video avatars within a virtual environment. The system introduces a "presented mode" where a presentation stream can be texture-mapped onto a screen within this virtual space. This setup also adjusts audio cues to reflect an avatar's position, enhancing the spatial awareness of participants. Video stream quality is dynamically adjusted based on the avatar's relative position in the virtual environment, facilitating a more immersive experience.

Background

Traditional videoconferencing tools, such as Zoom and FaceTime, allow users to transmit audio and video signals between remote locations. These platforms typically display participants in rectangular frames, which can switch focus based on who is speaking. While useful, these systems often lack the experiential and social nuances of physical meetings, like side conversations or private discussions. Moreover, they can struggle with performance issues when handling large numbers of participants due to bandwidth and hardware limitations.

Innovative Approach

The proposed system offers a novel approach by enabling three-dimensional modeling within a virtual video conferencing space. It allows participants to control avatars that are texture-mapped with their live video streams. This method not only enhances visual interaction but also preserves social dynamics by allowing avatars to move within the space, mimicking real-life interactions. The avatars are represented by meshes that can be controlled by participants, providing a sense of presence and engagement.

Technical Implementation

The system utilizes an interface where users can navigate their virtual cameras using keyboard and mouse inputs, similar to controls in massively multiplayer online games (MMOs). Participants can adjust their perspective by moving their virtual camera's position and orientation, offering a more interactive experience. Avatars are texture-mapped with live video feeds, ensuring that facial expressions and movements are visible, thereby enhancing communication.

Virtual Environment Details

The virtual environment is designed with various three-dimensional models, including arenas and decorative elements, which contribute to the overall setting of the videoconference. These models can be represented using different mathematical techniques such as polygon modeling or digital sculpting. The environment also incorporates light sources that interact with objects to create realistic lighting effects. This comprehensive setup aims to replicate the physical presence and interaction dynamics found in real-world meetings.