Skip to content Skip to search

Republish This Story

* Please read before republishing *

We’re happy to make this story available to republish for free under an Attribution-NonCommercial-NoDerivatives Creative Commons license as long as you follow our republishing guidelines, which require that you credit The 19th and retain our pixel. See our full guidelines for more information.

To republish, simply copy the HTML at right, which includes our tracking pixel, all paragraph styles and hyperlinks, the author byline and credit to The 19th. Have questions? Please email partnerships@19thnews.org.

— The Editors

Loading...

Modal Gallery

/
Sign up for our newsletter

Menu

Topics

  • Abortion
  • Politics
  • Education
  • LGBTQ+
  • Caregiving
  • Environment & Climate
  • Business & Economy
View all topics

Daily Newsletter

A smart, relatable digest of our latest stories and top news affecting women and LGBTQ+ people.

Look for a confirmation sent to

Did you mean

The email didn't go through.

or Contact us for support
  • Latest Stories
  • Our Mission
  • Our Team
  • Strategic Plan
  • Ways to Give
  • Search
  • Contact
Donate
Home

We’re an independent, nonprofit newsroom reporting on gender, politics, policy and power. Read our story.

Topics

  • Abortion
  • Politics
  • Education
  • LGBTQ+
  • Caregiving
  • Environment & Climate
  • Business & Economy
View all topics

Daily Newsletter

A smart, relatable digest of our latest stories and top news affecting women and LGBTQ+ people.

Look for a confirmation sent to

Did you mean

The email didn't go through.

or Contact us for support
  • Latest Stories
  • Our Mission
  • Our Team
  • Strategic Plan
  • Ways to Give
  • Search
  • Contact

We’re an independent, nonprofit newsroom reporting on gender, politics, policy and power. Read our story.

Daily Newsletter

A smart, relatable digest of our latest stories and top news affecting women and LGBTQ+ people.

Look for a confirmation sent to

Did you mean

The email didn't go through.

or Contact us for support

Become a member

The 19th thanks our sponsors. Become one.

Technology

On TikTok, misogyny and white supremacy slip through ‘enforcement gap’

A new report shows how extremists use profiles, hashtags and other effects that violate the platform’s community guidelines.

A photo of a mobile phone with the TikTok app.
(Photo Ilustration by Jakub Porzycki/NurPhoto via Getty Images)

Amanda Becker

Washington Correspondent

Published

2021-08-24 11:00
11:00
August 24, 2021
am
America/Chicago

Updated

2021-08-24 09:36:00.000000
America/Los_Angeles

Republish this story

Share

  • Bluesky
  • Facebook
  • Email

Republish this story

This article has been updated.

Violent extremists, neo-Nazis and other white supremacist groups are able to easily spread racist, misogynistic and anti-LGBTQ+ content on TikTok that runs afoul of the social media platform’s own terms of service, according to new research by the Institute for Strategic Dialogue (ISD).

The ISD report examines how extremists use profiles, hashtags, music and other effects on TikTok. Researchers identified a sample of 1,030 videos from 491 accounts, or about eight hours of content, that seemingly violated TikTok’s community guidelines. At least 312 of those videos promoted white supremacy and 246 expressed support for organizations or individuals known to be extremists or terrorists. At least 58 videos included misogynist content and 90 had anti-LGBTQ+ sentiments, ISD found. 

The 19th thanks our sponsors. Become one.

The TikTok content shows how white supremacist movements are often layered with elements of misogyny and anti-LGBTQ+ attitudes. Multiple videos in the sample were linked to the “Men Going Their Own Way” movement, which the Southern Poverty Law Center has categorized as a male supremacist group. Other videos used a white supremacist term to criticize women in mixed-race relationships. Some praised the mass shooter Elliot Rodger, who in 2014 killed six people near a California college campus and circulated a video and written manifesto saying that the attack was related to his hatred of women. 

Videos with anti-LGBTQ+ content celebrated the persecution of gay people by authoritarian regimes and the suicides of transgender people.

The 19th was given a preview of the study’s misogyny-related components ahead of the report’s release on Tuesday by ISD, a nonprofit organization of researchers and policy experts that tracks extremism online and makes recommendations to governments and businesses in the United States and overseas.

ISD researcher Ciaran O’Connor called the report a first-of-its-kind examination of how TikTok is used to spread white supremacy, neo-Nazism or other forms of hate speech. The study concludes there is an “enforcement gap” at TikTok and O’Connor hopes the findings will “start a conversation about the access or lack of access that researchers have when it comes to evaluating and examining hate at scale” on the platform.

O’Connor said that it is difficult for researchers to do large-scale searches of TikTok content so he used a “snowball methodology” — manually searching 157 keywords that led to accounts sharing far-right views, then looking at the accounts to which they were linked — to settle on the sample of 1,030 videos that seemingly violated TikTok’s community guidelines.   

Sign up for more news and context delivered to your inbox, daily

Delivered directly to your inbox every weekday.

Look for a confirmation sent to

Did you mean

The email didn’t go through.

or Contact us for support
Preview of the daily newsletter from The 19th

TikTok’s guidelines state that the platform will remove content from terrorist or criminal organizations and individuals who “attack people based on protected characteristics” such as race, gender, gender identity or sexual orientation, and that: “We consider attacks to include actions that incite violence or hatred, dehumanize individuals or groups, or embrace a hateful ideology.” 

News investigations have nevertheless revealed that TikTok is used by Islamic State militants and to promote neo-Nazism. While the platform has started releasing transparency reports with details about the content it has removed for violating its guidelines, it is not yet part of a consortium of tech giants such as Facebook, Twitter and YouTube involved in an industry anti-terrorism effort to collaboratively track and review content from white supremacists and far-right militia groups.

A TikTok spokesperson said the platform “categorically prohibits violent extremism and hateful behavior, and our dedicated team will remove any such content as it violates our policies and undermines the creative and joyful experience people expect on our platform. We greatly value our collaboration with ISD and others whose critical research on industry-wide challenges helps strengthen how we enforce our policies.”

ISD is recommending that TikTok improve its understanding of how creators spread extremist content and develop more nuanced policies that go beyond straight hashtag bans. The report also notes that TikTok’s interface is “severely limited in the data it provides to researchers or the public,” and suggests improvements to search functionality and greater transparency on how its algorithm works. 

Republish this story

Share

  • Bluesky
  • Facebook
  • Email

Recommended for you

A hand holds a smartphone against a solid purple background. On the phone’s screen, a black-and-white image shows two officers walking away, wearing vests labeled “POLICE ICE,” partially obscured by pink digital glitch lines.
TikTokers came to Springfield looking for ICE. Then the child trafficking rumors began.
The Grok X AI app is used on a mobile phone with the Grok logo visible in the background in this photo illustration.
Women and children are being digitally undressed on social media
A grainy illustration of the Capitol dome in in muted purple and gray tones, with digital glitch textures.
Senate moves to let victims of sexually explicit deepfakes sue for damages
A closeup of the 10 Commandments from the bible.
‘Public schools are not Sunday schools’: Texas parents win pause on Ten Commandments in classrooms

Daily Newsletter

A smart, relatable digest of our latest stories and top news affecting women and LGBTQ+ people.

Look for a confirmation sent to

Did you mean

The email didn't go through.

or Contact us for support

Become a member

Explore more coverage from The 19th
Abortion Politics Education LGBTQ+ Caregiving
View all topics

Support representative journalism today.

Learn more about membership.

  • Give $19
  • Give $50
  • Give $100
  • Any amount
  • Transparency
    • About
    • Team
    • Contact
    • Privacy Policy
    • Community Guidelines
    • Gift Acceptance Policy
    • Financials
  • Newsroom
    • Latest Stories
    • Strategic Plan
    • 19th News Network
    • Events
    • Careers
    • Fellowships
  • Newsletters
    • Daily
    • The Amendment
    • Menopause
  • Support
    • Ways to Give
    • Sponsorship
    • Republishing
    • Volunteer

The 19th is a reader-supported nonprofit news organization. Our stories are free to republish with these guidelines.