EU accuses TikTok's "rabbit hole" algorithm of endangering children, imposes heavy fines to force design changes

The European Union warned TikTok, a popular short video platform, on the 6th that the design of its personalized dynamic message push system "Recommended for You" (For You) is "harmful" to children and mentally fragile individuals. If it does not modify this design that violates EU digital content regulations, it will face a huge fine of up to 6% of its total global annual turnover.

Agence France-Presse reported that TikTok’s recommendation system will continue to push videos with similar content based on users’ previous interaction records. The EU accuses TikTok of causing harmful "rabbit hole" effects (falling deeper and deeper) and in some cases even leading users to more dangerous content, violating the EU's Digital Services Act (DSA).

The European Commission said that when users interact with a certain type of content more, TikTok’s “Recommended for You” dynamic messaging algorithm will recommend similar content. This design exposes users to content related to issues such as depression, loneliness, or body image, and repeated exposure may cause harm. The EU also found that even if users explicitly told TikTok that they did not like certain content, the platform’s algorithm would continue to recommend similar videos.

The EU stated that although TikTok has made some fine-tuning to reduce risks, the results are not effective and greater changes in system design must be made. The Executive Committee made several specific suggestions for changes, including:

Pay more attention to users' clear expression of preferences: the EU found that the "not interested" button in the application "seems insufficient to change the content of the push";

Disable "watch time" as a metric: it should no longer be used as a basis for content recommendations;

Enhance user controls: Make it easier for users to find and operate control functions, and regularly test their algorithms.

In response, a TikTok spokesperson countered that TikTok has a good record of protecting the community while giving users direct and intuitive control over their content experience. The EU's statement "distorts the architecture of our platform and our commitment to user safety."

The latest request is part of a series of EU actions to crack down on digital giants and protect children from online harm. In February this year, the EU asked TikTok to modify its "addictive" functional design; in July, the EU once again accused the company of exposing children to risks such as online bullying and grooming. A senior EU official revealed that the February investigation focused on functions such as notifications, while the accusations on the 6th were directed at the algorithm itself, admitting that the EU is targeting TikTok's business model based on "user engagement."

Preliminary investigation results show that the EU believes that TikTok has failed to "adequately assess" how its recommendation algorithm may endanger users' mental health, and is concerned that repeated exposure to specific content may lead to "increased feelings of depression or anxiety, body dissatisfaction, low self-esteem, or worsening existing eating disorders."

Once the EU regulator's charges are finally established, the Executive Committee will be able to fine TikTok up to 6% of its total global annual turnover. In addition to TikTok, the European Union also required Meta to modify the "addictive design" of Facebook and Instagram in July this year based on the "Digital Services Act." These social platforms face similar scrutiny and litigation challenges in the United States.