Skip to content
Breaking:

US Senators Demand Answers From TikTok Over Algorithmic Experiment That Withheld Safety Features

Lawmakers Marsha Blackburn and Richard Blumenthal set a Sept. 1 deadline for TikTok to explain why it withheld recommendation filters from millions of users to test engagement.

By The Company Wire3 min read
Share
TikTok — US Senators Demand Answers From TikTok Over Algorithmic Experiment That Withheld Safety Features
TikTok — US Senators Demand Answers From TikTok Over Algorithmic Experiment That Withheld Safety Features. Photo: Engadget.

U.S. Senators Marsha Blackburn and Richard Blumenthal have sent a formal letter to TikTok executive leadership, demanding answers regarding a 2021 internal trial in which the video platform suppressed an algorithmic safety mechanism for millions of accounts to monitor user engagement metrics.

The congressional inquiry follows reporting on the matter detailed by Engadget and Bloomberg regarding how TikTok designed a system modification to mitigate "repetitive patterns" or "filter bubbles" inside its primary "For You" recommendation feed. At the time of the initial rollout, the company publicly stated the adjustment was intended to prevent accounts from being exposed to excessive quantities of potentially harmful content categories delivered in rapid succession.

According to internal corporate documentation cited in the reporting, TikTok withheld the safety countermeasure from a control group comprising millions of active users so engineers could observe how the feature influenced overall app engagement. Among those placed in the control group was Chase Nasca, an American teenager who died by suicide. Internal files indicated Nasca's account received a continuous stream of self-harm, suicide, and depressive material leading up to his death.

In their joint correspondence, Blackburn and Blumenthal criticized the short-form video company for withholding protective measures from users while aware of the potential risks associated with its content recommendation algorithms. "These latest disclosures show that TikTok not only possessed information about the dangers created by its recommendation systems, but deliberately denied millions of users access to a safety intervention so that the company could study the intervention's impact on engagement," the senators wrote.

The lawmakers asked TikTok to detail the scope of the 2021 trial alongside any other similar testing programs. The letter specifically asks whether executives ever shelved or altered safety tools over concerns that those modifications would negatively impact platform engagement or advertising revenues. The senators set a deadline of September 1 for TikTok to provide complete documentation and responses.

The 2021 experiment began shortly after a TikTok policy representative testified before a Senate panel, where both Blackburn and Blumenthal pressed the business to strengthen safeguards for younger users. Both lawmakers have led legislative efforts surrounding online child safety, including championing the Kids Online Safety Act (KOSA).

Expressing frustration over the internal documents, the lawmakers noted that the platform had already been warned about algorithmic harms prior to initiating the control group trial. "These revelations are appalling, but they are made even more sinister because TikTok was on notice about the effects of its recommendation algorithms on children," the senators stated.

Sources

  1. Engadget

Company: TikTok

Written by

The Company Wire

Newsroom · San Francisco

Inside the companies building what’s next. Reporting on startups, technology, funding and the people shaping them.