US20240394480
2024-11-28
Physics
G06F40/35
The patent application describes a system designed to predict and mitigate controversial language in digital communications. By analyzing language within a user's communication, the system identifies controversial traits using a graph neural network that leverages historical data. This process results in an impact risk score that reflects the potential controversy of the communication based on the language used and the user's network. If the score surpasses a certain threshold, the system suggests alternative phrasing to reduce potential controversy.
Digital communications, especially on social media platforms, have become prevalent for public discourse. However, the rapid spread of messages can lead to harmful or divisive language affecting real-world scenarios. To foster respectful online interactions, platform owners aim to moderate content proactively. This system addresses these concerns by providing tools to preemptively detect and adjust controversial language, ensuring a more inclusive digital environment.
The method involves detecting language within a candidate communication linked to a user and their network. It interprets this language to spot controversial traits and calculates an impact risk score using a graph neural network. This score considers historical data and network-specific factors like culture or environment. When the score exceeds a threshold, the system identifies suitable replacement phrases and offers them as alternatives to the user.
The approach not only alerts users about potentially controversial content but also provides substitute communications that can be published instead. This feature helps maintain a positive user experience by offering clear explanations for flagged content, enhancing understanding of the network's cultural sensitivities. Additionally, feedback modules allow users to validate or challenge system suggestions, refining future predictions.
The invention can be implemented as a system, method, or computer program product, incorporating various technical levels of integration. It involves computer-readable instructions on storage media that guide processors to execute the described functionalities. This integration facilitates improved prediction and mitigation of controversial language through advanced AI and machine learning techniques.