Discord AI moderation bug wrongfully banned over 8,000 users
6 reported
Discord has acknowledged that a bug in its AI moderation system mistakenly banned more than 8,000 users over the past two months. The company confirmed the issue had been affecting accounts since May, with an additional 200 users banned over the weekend before the team identified and fixed the problem. Harmless images including spreadsheets, chessboards, game textures, and white and gray transparent backgrounds were incorrectly flagged as harmful content. Discord explained that its automated safety system works by matching uploaded content against databases of known harmful material, and while a human moderator typically reviews flagged content, a bug caused the system to immediately ban affected accounts. All affected accounts are currently in the process of being restored. The company wrote on X that it is “working on better safeguards so this can’t happen again.” Users on X and Reddit reported permanent suspensions for uploading images with square grid patterns, with some speculating that the AI has become sensitive to grid-like patterns used to disguise harmful content.
What’s reported
Discord acknowledged a bug in its AI moderation system that mistakenly banned more than 8,000 users over two months.
The issue had been affecting accounts since May, with an additional 200 users banned over the weekend before the fix.
Harmless images flagged included spreadsheets, chessboards, game textures, and white and gray transparent backgrounds.
A bug caused the system to immediately ban accounts instead of waiting for human moderator review.
All affected accounts are in the process of being restored.
Discord stated it is working on better safeguards to prevent recurrence.
Key figures
Discord Support (via X account @discord_support)
JDBRYANT (X user @jdbryantdev, identified as a game director)
Sources: TechCrunch
