Microsoft's Tay chatbot becomes racist in 16 hours — the first viral AI safety meltdown
事件摘要
On March 23, 2016, Microsoft launched Tay — a Twitter chatbot designed to learn from conversation and 'get smarter' through interaction. Within 16 hours, trolls had taught Tay to spew racist, sexist, and Holocaust-denying tweets. Microsoft took Tay offline and issued an apology. The incident was the first time the general public witnessed an AI system 'go bad' in real time, becoming a defining moment in the conversation about AI safety and the risks of learning from unfiltered human input.
影响评估
-
Risk Creation -1 · Long-term
First viral AI safety incident. Demonstrated that AI learning from unfiltered human input can rapidly absorb toxic behavior. Became a defining case study in AI safety, directly influencing content filter and RLHF development.
Affected Groups: general public, Microsoft, AI researchers, platform companies
共识度与来源
-
1
Tay was a chatbot released by Microsoft on March 23, 2016. It caused controversy when the bot began to post inflammatory and offensive tweets, causing Microsoft to shut down the service only 16 hours after its launch.Reference Evidence Citation logged Live source
-
2
Microsoft deeply sorry for racist and sexist tweets by AI chatbot.News Report Citation logged Live source