First Lawsuit Filed Against Deepfake Pornography Websites
For the first time, a lawsuit has been filed in San Francisco against major websites involved in the creation and distribution of deepfake pornography. City Attorney David Chiu announced legal action against the owners of 16 of the most popular sites that allow users to generate pornographic images of women and girls without their consent.
These websites provide interfaces where users can upload photos of clothed women and girls, which are then transformed into realistic pornographic images. In the first six months of 2024, these sites received over 200 million visits.
The City Attorney emphasized that while generative AI has enormous potential, its use in this context is not innovation but sexual violence. Authorities aim to draw attention to the dangers posed by using AI to create and distribute such images and are committed to combating this issue at all levels.
The availability of free, advanced, open-source AI models has enabled criminals to train and develop these models for their own purposes, using pornographic images and materials related to child sexual abuse. This has allowed them to create images of real women and girls that are indistinguishable from actual photographs. Such images are used for extortion, intimidation, and humiliation, creating new types of crimes.
The plaintiff is seeking the removal of these websites and a court order banning their further operation. The lawsuit, filed on behalf of California residents, accuses the site owners of violating both state and federal laws regarding deepfake pornography, revenge porn, and child sexual abuse materials. The suit also requests fines and reimbursement of legal expenses.
The lawsuit aims to protect individuals’ rights to control their own image and reputation, as well as to prevent the use of AI technologies for criminal purposes. According to the prosecutor’s press release, this is an important step in addressing new threats emerging in the digital age. City officials urge anyone who has encountered deepfake pornography or has information related to this issue to contact the City Attorney’s office.