TikTok Tightens Rules on AI Spam

TikTok has announced plans to strengthen its systems for detecting AI-generated spam, with testing set to begin in the coming weeks. The initiative will focus on accounts that repeatedly publish AI-created content in areas where misinformation could have serious consequences.

The platform has identified politics and current affairs, financial advice, and health-related content as its initial priority categories, as misleading information in these areas has the potential to affect public trust and people’s wellbeing.

Focus on High-Risk Content

According to TikTok, the new detection measures will operate at account level rather than targeting individual posts.

The company says it already removes large volumes of spam and fake accounts, revealing that more than 86 million fake profiles were taken down during the first quarter of the year alone.

Health content has become a particular area of concern, following recent research that found it to be one of the most common subjects for AI-generated videos on the platform.

Wider Industry Efforts

TikTok’s latest announcement reflects a broader move across the technology industry to tackle low-quality and AI-generated content.

Other major platforms have recently introduced similar measures. YouTube updated its monetisation policies to address repetitive and inauthentic videos, while Meta also strengthened its efforts to reduce unoriginal content.

Google has also developed new technology designed to identify coordinated networks of accounts distributing AI-generated spam across the web.

Supporting Content Authenticity

Alongside its spam detection plans, TikTok has joined the steering committee of the Coalition for Content Provenance and Authenticity (C2PA), the organisation responsible for developing standards that help verify where digital content originates and whether it has been altered.

TikTok says it was the first video-sharing platform to introduce C2PA Content Credentials and has already labelled more than three billion AI-generated videos using a combination of creator disclosures, Content Credentials and invisible watermarking technology.

The company believes its involvement with the C2PA steering committee will help encourage wider adoption of content verification standards across the industry.

What It Means for Creators

Creators producing content about finance, healthcare or politics may notice increased scrutiny as TikTok expands its detection systems.

However, the company has not yet explained exactly how accounts will be assessed or what action will be taken if they are identified as posting AI-generated spam. It has also not confirmed a specific launch date beyond saying that testing will begin in the coming weeks.

As AI-generated content continues to grow across social media, TikTok’s latest measures signal a stronger focus on improving content authenticity while limiting the spread of misleading information.