OpenAI banned a set of ChatGPT accounts originating in Rwanda that were generating partisan tweets ahead of the country’s elections. This activity was linked to individuals in Rwanda. The initial lead for this action came from reporting published by researchers at Clemson University. This case study was originally published in OpenAI’s October 2024 report.
The activity focused on generating batches of short comments, often including hashtags. These comments were posted on X by various accounts, some of which posted at high volumes, reaching hundreds of tweets per hour. On some occasions, the same tweet was posted by multiple accounts. After the initial disruption, newly created accounts generating similar content were identified and banned.
Key Points
- OpenAI banned ChatGPT accounts originating in Rwanda that generated partisan tweets ahead of elections.
- The activity was linked to individuals in Rwanda and was initially flagged by Clemson University researchers.
- The network generated short comments, typically with hashtags, posted on X at volumes of hundreds of tweets per hour.
- Posts frequently used hashtags such as #RPFOnTop, #PKNiWowe, and #ToraKagame24.
- Content was primarily in English, but also included French and Kinyarwanda.
- The operation generated thousands of tweets, but these posts received minimal engagement, often single-digit replies, likes, or shares.
- The use of consistent hashtags across many posts suggests an aim to make those hashtags trend on X.
Context
According to OpenAI, the activity is characterized as “theme and variations,” where operators generated numerous posts about the benefits attributed to the Rwandan Patriotic Front party. The high volume of comments on specific themes often resulted in similar wording and structure across posts, which OpenAI notes can be a characteristic feature exposing such content generation.
Why It Matters
This action demonstrates OpenAI's intervention against coordinated inauthentic behavior leveraging AI for political commentary. The case highlights how AI-generated content can be used for large-scale, low-engagement spamming tactics aimed at influencing online discourse, such as trending hashtags.
What To Do
- Note the characteristics of AI-generated content identified by OpenAI, such as high volume, similar wording, and low engagement.
- Observe how consistent hashtag usage can indicate attempts to manipulate trending topics.
- Review OpenAI's October 2024 report for further details on their safety interventions.
Keep Exploring
/atlas/gpt-family /techniques/system-user-separation /techniques/constraints /techniques/output-schema
