US20250097548
2025-03-20
Electricity
H04N21/8545
The mixed-reality media content system enhances user interaction with printed materials by integrating augmented reality (AR) technology. It displays image data on a client device, featuring objects with graphical codes like QR codes. By detecting these codes, the system accesses media content from a repository and presents it on the client device, aligning it precisely with the graphical code's position on the object.
Users can generate graphical codes using a client device's graphical editor. Upon detecting a code, the system uses surface detection techniques to determine the object's surface characteristics. This includes skew, rotation, and position, ensuring accurate media content presentation. The content is adjusted to fit within defined boundaries or bounding boxes, either by scaling to avoid cut-offs or filling the space completely.
The system leverages depth information from the client device to create a 3D mesh that represents the object's surface curvature. This mesh is updated regularly or when significant changes are detected, ensuring precise rendering of media content. Edge detection algorithms help fit media content within detected frames, maintaining proportional scaling for optimal display.
The system supports tactile and hand-tracking inputs, allowing users to interact with media content through collision detection with interactive icons. Each icon corresponds to specific functions or features of the media content. This interaction enables users to execute functions or access additional content directly through their inputs.
An illustrative example involves scanning a QR code printed on a newspaper or magazine. The system retrieves related media content and adjusts its display based on the publication's curvature and orientation. Users view this content on their device's GUI and can interact with it through tactile inputs, triggering further actions or accessing additional information seamlessly.