In today's digital landscape, a disturbing trend has emerged, and it's time we shed light on it. The rise of AI-generated hate speech, particularly on Facebook, has taken an insidious turn, and the culprits might surprise you.
The Face of Hate
Imagine scrolling through your Facebook feed, and amidst the usual updates, you stumble upon a post claiming that a local cafe has stopped serving pork to avoid offending certain individuals. The profile picture is a Union Jack, and the name suggests a British patriot. But here's the twist: the person behind this account is likely a young man from South Asia, with little to no interest in UK politics.
These accounts, hundreds or even thousands of them, have become a breeding ground for far-right ideologies and Islamophobia. They exploit the power of AI to create compelling, yet toxic, content that fuels hatred and contributes to an increasingly hostile environment for immigrants and British Muslims.
The Business of Hate
What's even more concerning is the financial incentive behind this hate-mongering. These creators, often from the global south, are part of a thriving 'cottage industry' that generates 'commercial AI slop.' They make money through online ads placed by Meta, which shares ad revenue and makes direct payments for highly engaging posts.
The success stories are eye-opening. One Pakistani creator, a devout Muslim, claims to make $1,500 a month from a single page. Another, Geeth Sooriyapura from Sri Lanka, boasts of earning $300,000 over his Facebook career. This represents the allure of 'passive income' culture, where the promise of easy money online has become a modern-day gospel.
The Perfect Storm
Two key factors have contributed to the proliferation of this hate speech. Firstly, the wide availability of generative AI tools has made it easier than ever to create compelling content, even for those with limited language skills. Secondly, Meta's retreat from content moderation, influenced by political pressures, has created a safe haven for harmful content to thrive.
The Impact
The impact of these accounts is hard to ignore. The comments beneath these videos are a toxic mix of deportation calls, fantasies of ethnic civil wars, and cry-laughing emojis at the sight of AI-generated videos depicting migrants drowning. It's a digital echo chamber that amplifies hatred and normalizes extreme views.
A Call to Action
While Meta has taken down some of these accounts after being contacted, the problem persists. As long as the core product remains an algorithmic feed that rewards extreme content, these accounts will continue to pop up. It's time for Meta and other social media platforms to take a stand and implement stricter policies to combat this hate-mongering industry.
In my opinion, we need to hold these platforms accountable for the content they host and the impact it has on our society. It's a complex issue, but one that demands our attention and action.