Home ENTERTAINMENT Deepfake: X implements restrictions on Taylor Swift searches amidst deep-fake image controversy

Deepfake: X implements restrictions on Taylor Swift searches amidst deep-fake image controversy

161
0
(This story originally appeared in on Jan 28, 2024)

Last week, explicit AI-generated images of Taylor Swift surfaced on X (formerly Twitter), causing a significant stir on social media. Responding to the outcry, X swiftly implemented measures to block searches for ‘Taylor Swift.’ The move comes amid growing concerns about the platform’s content moderation and safety protocols.

Blocking ‘Taylor Swift’ Searches on X:

A Temporary Safety Measure:

A recent report by The Verge revealed that searches for “Taylor Swift” or “Taylor Swift AI” on X now yield a message without displaying any images. Independent verification by the Times of India-Gadgets Now team confirmed this restriction. Attempts to retrieve results with the same prompts led to a message stating, “Something went wrong, but don’t fret — it’s not your fault.” However, altering the prompt to include terms like “Taylor Swift AI images” or “Taylor Swift deepfake image” produced a mix of images, including both originally captured and AI-generated non-explicit photos.

X’s head of business, Joe Benarroch, acknowledged the blocking as a “temporary” measure aimed at prioritizing safety, according to The Wall Street Journal. The platform faced a surge in explicit images of the pop star circulating and being shared before the company began removing them. Some of these images garnered millions of views, with one reportedly reaching 47 million before being taken down.

Backlash from Politicians and Tech CEOs:

The incident prompted criticism from various quarters, including politicians and tech CEOs. Microsoft’s Satya Nadella was among those expressing concern over the development. The controversy surrounding AI-generated explicit content raises questions about the platform’s ability to effectively manage and moderate user-generated content.X’s Strategic Move:

Hiring for Trust and Safety Office in Austin:

In response to mounting concerns, X has announced plans to hire 100 full-time employees for a new trust and safety office in Austin, Texas. This move is strategically timed, just days before company CEO Linda Yaccarino is set to testify before the Senate Judiciary Committee on January 31. The hearing will address X’s approach to moderating child sexual exploitation content.

Content Moderation Challenges Post-Musk Takeover

Notably, the decision to establish a trust and safety office follows the aftermath of Elon Musk’s takeover of the company. Musk made sweeping changes, including the dismissal of a significant portion of the staff responsible for flagging and removing inappropriate content from the platform. This restructuring has led to increased scrutiny and calls for more robust content moderation policies.

Amidst these developments, the incident involving Taylor Swift’s AI-generated images highlights the ongoing challenges faced by social media platforms in maintaining a safe and secure online environment. The debate over content moderation and safety measures is expected to gain further attention as platforms like X navigate the complex landscape of user-generated content in the digital age.