FACIAL SYNTHESIS IN AUGMENTED REALITY CONTENT FOR ADVERTISEMENTS

Smart overview of the Invention

The patent application focuses on a technology that processes source media content featuring a source actor's face and head to generate pose parameters. These parameters are then applied to a target image containing a target entity's face and head, creating an output media content that incorporates the target face. This output is primarily used for online advertisements displayed on computing devices, enhancing the advertising experience through augmented reality (AR) content.

Background

The increasing integration of digital images into daily life, driven by advancements in portable computing devices, digital storage, and network accessibility, has created a demand for innovative image processing capabilities. Augmented reality technology enhances real-world environments by overlaying electronic information, making it appear as part of the real world. This technology also provides interactive user interfaces for engaging with the augmented content.

Technical Details

The proposed system allows for the synthesis of facial animations by transferring expressions from a source video to a target video or image. This capability is beneficial for various applications, including entertainment, gaming, and virtual or augmented reality experiences. The system addresses limitations of existing techniques that either lack photorealism or are too slow for real-time application on standard mobile devices.

Messaging System Integration

The technology integrates into messaging systems, enhancing functionality by improving image data capture and AR content rendering. It reduces latency and power consumption in resource-constrained devices. The system supports interactive media creation and sharing, incorporating 3D content or AR effects via live camera inputs or stored data. Users can interact with AR content through motion sensors and external effect loading.

System Architecture

The messaging system architecture includes client devices hosting messaging applications connected to a server system via a network. The server provides functionalities such as data exchange, media annotation, and social networking features through APIs. This infrastructure supports various services like account management, media sharing, and social graph interactions, facilitating a seamless user experience with AR-enhanced messaging.