Invention Title:

AUGMENTED PERFORMANCE REPLACEMENT IN A SHORT-FORM VIDEO

Publication number:

US20240233775

Publication date:
Section:

Physics

Class:

G11B27/036

Inventors:

Assignee:

Applicant:

Drawings (4 of 11)

Smart overview of the Invention

Techniques for enhancing short-form videos involve replacing the performance of one individual with another. This process begins by isolating specific elements of the original performance, such as gestures, clothing, and expressions. By utilizing advanced processors, an image of a second individual is retrieved and analyzed to extract pertinent information that will enable their performance to be integrated into the video.

Creation of a New Short-Form Video

The new video is generated by substituting the original performer with the second individual, effectively creating a second short-form video. This replacement is conducted using machine learning technologies, ensuring that the new performance aligns closely with the original's intent and style. The integration process allows for a seamless transition between the two performers while maintaining the video's overall quality.

Dynamic Augmentation Based on Viewer Interaction

Once the second short-form video is created, it undergoes dynamic augmentation based on viewer engagement. This enhancement includes incorporating additional audio content that responds to real-time comments, polls, or questions from viewers. The ability to switch audio tracks further enriches the viewing experience by aligning the content more closely with audience preferences.

Importance of Short-Form Videos in Communication

Short-form videos play a crucial role across various sectors such as education, marketing, and entertainment. As audiences become increasingly selective about content, finding the right spokesperson can significantly impact product promotion and audience engagement. The use of influencers and tastemakers in these videos can enhance their effectiveness and reach within social media platforms.

Leveraging AI for Enhanced Content Creation

The integration of artificial intelligence and machine learning into video production streamlines the creation process, allowing for real-time adaptations during livestream events. By analyzing performances and isolating key features, AI can facilitate the replacement of individuals in videos while preserving authenticity. This innovative approach not only improves engagement but also transforms how content is produced and consumed in today's digital landscape.