Sign language control for a virtual meeting

Smart overview of the Invention

Systems and methods are designed to assist hearing-impaired users in managing virtual conferencing systems using sign language. By detecting hand gestures within a defined area, these systems can interpret commands and adjust meeting controls accordingly. This functionality enables users to maintain communication without interruptions that typically arise from needing to pause signing for control inputs.

Challenges Faced by Hearing-Impaired Users

During video conferences, hearing-impaired users often face challenges when needing to access controls like mute, video on/off, or recording features. Interruptions caused by switching from signing to using traditional input devices can disrupt the flow of conversation, making it difficult to maintain engagement. The proposed systems allow for seamless control activation through hand gestures, facilitating smoother interactions.

Gesture Detection Techniques

The detection of hand gestures can be achieved through various methods. One approach includes overlaying control icons on the video feed, allowing users to interact directly with the controls. Alternatively, a predefined area monitored by a camera can be established for gesture detection. Multiple cameras may also be employed, dedicating one specifically for control inputs while the other focuses on video conferencing.

System Architecture and Functionality

The system comprises a video conference provider connected to different communication networks, enabling multiple client devices to participate in virtual meetings. Users can create meetings by providing necessary details such as date, time, and participant information. The provider facilitates functionalities like recording and managing breakout rooms, enhancing the overall meeting experience.

Meeting Management Process

To initiate a meeting, users access the video conference provider through their devices and input relevant information. After setting up the meeting, participants receive identifiers to join at the scheduled time. During the meeting, audio and video streams are exchanged between participants and the provider. Once concluded, the meeting is terminated, disconnecting participants and invalidating session details.