Biotech & Health

Study finds Reddit’s controversial ban of its most toxic subreddits actually worked

Comment

It seems like just the other day that Reddit finally banned a handful of its most hateful and deplorable subreddits, including r/coontown and r/fatpeoplehate. The move was, at the time, derided by some as pointless, akin to shooing criminals away from one neighborhood only to trouble another. But a new study shows that, for Reddit at least, it has had lasting positive effects.

The policing of hate speech online has become a flash point for many a flame war, these past few months especially, as white nationalists, neo-nazis and others with abhorrent but strictly speaking quite legal viewpoints struggle with being banned repeatedly from the internet’s biggest platforms.

The practice has led sites like StormFront to seek shelter at dismal ports like off-brand hosts and small social networks pitching their tolerance of certain types of free speech being “censored” by others. It’s an example of one of the objections made to the idea of banning troublesome users or communities: they’ll just go elsewhere, so why bother?

Researchers at the Georgia Institute of Technology took this question seriously, as until someone actually investigates whether such bans are helpful, harmful or some mix thereof, it’s all speculation. So they took a major corpus of Reddit data (compiled by PushShift.io) and examined exactly what happened to the hate speech and purveyors thereof, with the two aforementioned subreddits as case studies.

Essentially they looked at the thousands of users that made up CT and FPH (as they call them) and quantified their hate speech usage. They then compared this pre-ban data to the same users post-ban: how much hate speech they produced, where they “migrated” to (i.e. duplicate subreddits, related ones, etc.) and whether “invaded” subreddits experienced spikes in hate speech as a result. Control groups were created by observing the activity of similar subreddits that weren’t banned.

What they found was encouraging for this strategy of reducing unwanted activity on a site like Reddit:

  • Post-ban, hate speech by the same users was reduced by as much as 80-90 percent.
  • Members of banned communities left Reddit at significantly higher rates than control groups.
  • Migration was common, both to similar subreddits (i.e. overtly racist ones) and tangentially related ones (r/The_Donald).
  • However, within those communities, hate speech did not reliably increase, although there were slight bumps as the invaders encountered and tested new rules and moderators.

All in all, the researchers conclude, the ban was quite effective at what it set out to do:

For the definition of “work” framed by our research questions, the ban worked for Reddit. It succeeded at both a user level and a community level. Through the banning of subreddits which engaged in racism and fat-shaming, Reddit was able to reduce the prevalence of such behavior on the site.

Of course, it’s not so simple as all that. Naturally, many of the users who previously spewed racial slurs at CT just moved over to Gab or Voat, where their behavior is proudly fostered. But the point of the bans at Reddit wasn’t to eliminate racism; it was to discourage it on the platform. To that end, it accomplished its goal (I’ve asked Reddit what it thinks of the study and its conclusions). And similar strategies may work for other platforms.

The question of how to to combat racism and hatred at large is one that is really too much for a major platform like Reddit or even Google or Facebook. The best they can hope to do is strike at it when and where it appears. But as ineffective as that might seem, it worked for Reddit and it may work elsewhere: bigotry is easy and those who cherish it are lazy. Make it difficult and many people may find it more trouble than it’s worth to harass, shame, and otherwise abuse online those different from themselves.

More TechCrunch

California Governor Gavin Newsom is currently considering 38 AI-related bills, including the highly contentious SB 1047, which the state’s legislature sent to his desk for final approval. These bills try…

Here is what’s illegal under California’s 8 (and counting) new AI laws

A New York Times article Thursday highlighted a lucrative side hustle that is emblematic of the times we live in: gaming algorithms to earn money. In this case, folks figured…

Gaming Lyft’s Citi Bike algos was a lucrative side hustle for a while

This is the chipmaker’s second round of layoffs over the past year, while the company recorded billions in revenue.

Chipmaker Qualcomm lays off hundreds of workers in San Diego

SpaceX sent a letter to top congressional leaders on Wednesday denying allegations that it violated its launch licenses on two separate occasions last year, which has resulted in regulators seeking…

SpaceX disputes $633K FAA fine, citing ‘systematic challenges’ with agency

California’s newest law could land social media users who post, or repost, AI deepfakes that deceive voters about upcoming elections in legal trouble. Governor Gavin Newsom suggests that AB 2839,…

Elon Musk’s reposts of Kamala Harris deepfakes may not fly under new California law

The team points to glass’ optical properties and its “infinite recyclability” as reasons for turning to the material.

MIT develops recyclable 3D-printed glass blocks for construction

A new FTC report on how social media and streaming sites collect and monetize their hoards of user data doesn’t really feature a lot of surprises for anyone who’s followed…

FTC report on predatory social media data hoarding hints at future regulations

Test subjects were required to move a 30-pound kettlebell up and down a flight of stairs.

This robotic knee exoskeleton is made from consumer braces and drone motors

California residents can now store their driver’s license or state ID in their Apple Wallet apps, the state’s government announced on Thursday. California started allowing digital IDs through Google Wallet…

Apple, Google wallets now support California driver’s licenses

I recently adopted a kitten from a local animal shelter. The modern, well-staffed three-story facility relies almost entirely on donations to operate. It’s just one of the 1.8 million nonprofits…

Virtuous, a fundraising CRM for nonprofits, raises $100M from Susquehanna Growth Equity

Elon Musk is suing the FAA over fines he claims are “politically-motivated.” The former head of the FAA disagrees.

No, the FAA isn’t fining SpaceX because of Elon Musk’s politics, former FAA head says

Starting Thursday, those who are enrolled in Apple’s public beta program will be able to experience the generative AI-fueled platform the company has been talking up since June.

Apple Intelligence is now live in public beta. Here’s what it offers and how to enable it.

This week’s Mobility newsletter looks at a leadership shakeup at Motional, and we go inside the fight over TuSimple’s cash and much more.

A leadership shake-up at Motional, inside the fight over TuSimple’s cash, and Fisker waffles on recall repairs

The company said Thursday that it will put “several” vehicles driven by humans in the two cities that will initially perform mapping.

Cruise robotaxis return to the Bay Area nearly one year after pedestrian crash

The company said it was inspired to create an alternative Photos app after seeing how frustrated iOS 18 early adopters were with Apple’s new design.

For $5, Photon Library brings back the feel of the old iOS Photos app

On Monday, Apple released its latest computer operating system update called macOS 15, or Sequoia. And, somehow, the software update has broken the functionality of several security tools made by…

Apple’s new macOS Sequoia update is breaking some cybersecurity tools

Passkeys, the digital credentials that let you sign into apps and websites without entering a password, are getting easier to use for Chrome users. You can now save passkeys to…

Google rolls out automatic passkey syncing via Password Manager

Launching a new product is challenging, but doing it in a space dominated by tech giants requires bold innovation, sharp strategy, and the ability to scale quickly. TechCrunch Disrupt 2024…

Quilt, Furno Materials, and RA Capital Management share the stage at TechCrunch Disrupt 2024

Back Market held a press conference on Thursday morning in Paris to talk about upcoming product launches and give an update on the company’s current situation. If you’re not familiar…

Back Market lays out its plan to make refurbished phones go mainstream

UPchieve, the free, 24/7 online tutoring and college counseling app for low-income students, announced Thursday it’s giving teachers in Title 1 middle schools and high schools a new tool to…

UPchieve, an online tutor app for low-income students, launches a free tool for teachers

In a world where innovation knows no borders, a new trend is rising in the tech ecosystem: national-interest startups. From aerospace and defense to critical infrastructure, these firms are ensuring…

Dcode Capital, Albedo, and Biofire are coming to TechCrunch Disrupt 2024

Startup Battlefield 200 is a major highlight at every Disrupt, and we’re thrilled to find out which of the thousands of startup applicants will get the chance to pitch to…

Announcing our next wave of Startup Battlefield judges at TechCrunch Disrupt 2024

Like its rival, Google, Amazon has launched an AI-powered video generator — but it’s only for advertisers at the moment, and somewhat limited in what it can do. Today at…

Amazon releases a video generator — but only for ads

The startup, previously known as GreenBlu, was working on desalination when it realized there was more value in the minerals that were left behind.

Tidal Metals sees seawater as the solution to a critical mineral shortage

Amazon sellers now have access to an AI assistant designed to help grow their business by answering questions about their metrics, and later, helping to resolve issues that arise. The…

Amazon debuts Project Amelia, an AI assistant for sellers

The startup has been methodically exploring how batteries might transform life in emerging markets.

Zeno emerges from stealth to crib Tesla’s master plan for Africa and beyond

In many meetings today, it sometimes feels like there are more AI notetaking and transcription bots than people. There are seemingly dozens of options to choose from these days, but…

AI notetaker Fathom raises $17M

Like most good startup stories, Harbor began life as a product of disappointment. Kevin Lavelle, the co-founder and CEO of innovative clothing company Mizzen and Main, couldn’t find a baby…

Harbor is building a better baby monitor and an army of night nannies

There’s ample opportunity in the form of a mobile billboard. Kiwibot is so convinced of this fact that it plunked down $25 million to purchase Nickelytics.

Kiwibot acquires an ad startup to turn its delivery robots into mobile billboards

The startup will use turbomachinery to develop a heat pump capable of generating industrial-grade heat.

Karman Industries hopes its SpaceX-inspired heat pumps will replace industrial boilers