FACIAL SYNTHESIS IN AUGMENTED REALITY CONTENT FOR ONLINE COMMUNITIES

Smart overview of the Invention

The patent application describes a technology that captures image data, specifically focusing on facial expressions and lip movements of a target actor. This data is used to generate augmented reality (AR) content by integrating it with frames from source media content. Users can select specific facial expressions, which are then synthesized into output media content for display on computing devices, enhancing online community interactions through realistic facial animations.

Background

The increasing use of digital images and the widespread availability of portable computing devices have made digital images integral to daily life. This trend is supported by advances in digital storage and network bandwidth. However, processing these images, especially under varying conditions like lighting or movement, is computationally demanding. Augmented reality aims to enhance real-world environments by overlaying them with digital information, creating an interactive user experience.

Technical Description

The technology enables users to capture and share digital images with enhanced features through AR. It supports face animation synthesis by transferring facial expressions from a source video to a target image or video. This process is applicable in various fields such as entertainment and virtual reality. The technology addresses challenges of photorealism and real-time processing on mobile devices by improving efficiency and reducing power consumption during image data capture.

System Architecture

The messaging system described facilitates the creation and sharing of interactive media, including AR effects, across its components. Messages can originate from live camera feeds or stored data and support motion sensor input. The system includes a client device running a messaging client application connected to a messaging server system via a network. This setup allows for the exchange of multimedia data and commands between clients and servers, supporting various user interactions and content sharing.

Server Functionality

The messaging server system provides server-side functionality through an API server that interfaces with an application server and a database server. This infrastructure supports operations like account management, message transmission, media file handling, social networking features, and event management. The API server enables messaging client applications to invoke server functions, facilitating seamless interaction and data processing across the messaging platform.