Augmented Call Spawn Configuration for Digital Human Representations in an Artificial Reality Environment

Smart overview of the Invention

The patent application discusses the creation and use of digital human representations (DHRs) in augmented calls within an artificial reality (XR) environment. DHRs can be two-dimensional (2D) images, videos, or avatars of users. The application introduces two types of calls: compact mode and spatial mode. Compact mode allows for multitasking by enabling users to interact with the XR environment while performing real-world tasks. In contrast, spatial mode immerses users fully in the XR environment, facilitating more natural face-to-face interactions.

Technical Field and Background

The application is situated in the context of video conferencing and XR technologies, which include virtual reality (VR), augmented reality (AR), and mixed reality (MR). These technologies are transforming digital interactions by offering immersive experiences that closely mimic face-to-face communication. Traditional video calls often fail to convey body language and relational movements effectively, whereas XR systems can provide 3D video calls that enhance interpersonal interactions through realistic avatars or holograms.

Call Modes and DHR Types

DHRs are utilized in both compact and spatial mode calls. Compact mode is designed for multitasking, allowing users to engage with XR environments alongside real-world activities. Spatial mode offers a more immersive experience, with life-sized DHRs that provide naturalistic interactions. Users can transition between these modes during a call. DHR types can be manually selected or automatically determined based on device capabilities, with options including 2D images, avatars, and videos, each requiring different levels of network capability.

Initiating Calls and Spawning DHRs

To start a compact mode call, users select contacts via their XR devices using identifiers like phone numbers or usernames. Calls can include multiple participants, with DHRs rendered over real-world views. The spawning location for spatial mode calls is determined by spatial anchors shared between participants, ensuring consistent placement of virtual objects and DHRs in the XR environment. Parameters like user height influence how DHRs are positioned to maintain realism.

Interaction Dynamics

DHRs can move within the XR environment beyond their initial spawning circle but maintain a common entry point for consistency. Different DHR types may have varying spawning parameters, allowing for diverse representation forms within the same call. Although described as "call sender" and "call receiver," both participants act in dual roles, capturing and transmitting data simultaneously. The system supports artificial reality applications across various platforms, including head-mounted displays and mobile devices.