Deepfake pornography

From HandWiki

Deepfake pornography, or simply fake pornography, is a type of synthetic porn that is generated by using deepfake technology. Many deepfakes on the internet feature pornography of people, often female celebrities whose likeness is typically used without their consent.[1]

History

[2] prominently surfaced on the Internet in 2017, particularly on Reddit.[3] The first one that captured attention was the Daisy Ridley deepfake, which was featured in several articles.[3] Other prominent pornographic deepfakes were of various other celebrities.[3][4][5][6] A report published in October 2019 by Dutch cybersecurity startup Deeptrace estimated that 96% of all deepfakes online were pornographic.[7]

In December 2017, Samantha Cole published an article about r/deepfakes in Vice that drew the first mainstream attention to deepfakes being shared in online communities.[8] Six weeks later, Cole wrote in a follow-up article about the large increase in AI-assisted fake pornography.[9] Since 2017, Samantha Cole of Vice has published a series of articles covering news surrounding deepfake pornography.[10][11][12][13][6][14][8][9]

Since then, multiple social media outlets have banned or made efforts to restrict deepfake pornography. Most notably, the r/deepfakes subreddit on Reddit was banned on February 7, 2018, due to the policy violation of "involuntary pornography".[15][16][17][18][19][20] In the same month, representatives from Twitter stated that they would suspend accounts suspected of posting non-consensual deepfake content.[14]

Scarlett Johansson, a frequent subject of deepfake porn, spoke publicly about the subject to The Washington Post in December 2018.[21] In a prepared statement, she expressed that despite concerns, she would not attempt to remove any of her deepfakes, due to her belief that they do not affect her public image and that differing laws across countries and the nature of internet culture make any attempt to remove the deepfakes "a lost cause".[21] While celebrities like herself are protected by their fame, however, she believes that deepfakes pose a grave threat to women of lesser prominence who could have their reputations damaged by depiction in involuntary deepfake pornography or revenge porn.[21]

In June 2019, a downloadable Windows and Linux application called DeepNude was released which used neural networks, specifically generative adversarial networks, to remove clothing from images of women. The app had both a paid and unpaid version, the paid version costing $50.[13][22] On June 27 the creators removed the application and refunded consumers, although various copies of the app, both free and for charge, continue to exist.[23]

Efforts to limit deepfake pornography

On January 31st, 2018, Gfycat began removing all deepfakes from its site.[12][24]

In February 2018, r/deepfakes was banned by Reddit for sharing involuntary pornography.[20] Other websites have also banned the use of deepfakes for involuntary pornography, including the social media platform Twitter and the pornography site Pornhub.[14] However, some websites have not banned deepfake content, including 4chan and 8chan.[25]

Also in February 2018, Pornhub said that it would ban deepfake videos on its website because it is considered “non consensual content” which violates their terms of service.[11] They also stated previously to Mashable that they will take down content flagged as deepfakes.[26] Writers from Motherboard from Buzzfeed News reported that searching “deepfakes” on Pornhub still returned multiple recent deepfake videos.[11]

Chat site Discord has taken action against deepfakes in the past,[27] and has taken a general stance against deepfakes.[24][28]. In September 2018, Google added "involuntary synthetic pornographic imagery” to its ban list, allowing anyone to request the block of results showing their fake nudes.[29]

References

  1. Dickson, E. J.; Dickson, E. J. (2019-10-07). "Deepfake Porn Is Still a Threat, Particularly for K-Pop Stars" (in en-US). https://www.rollingstone.com/culture/culture-news/deepfakes-nonconsensual-porn-study-kpop-895605/. 
  2. Roettgers, Janko (2018-02-21). "Deepfake pornography" (in en-US). Variety. https://nsfwaitools.com/top-deepfake-porn-makers/. 
  3. 3.0 3.1 3.2 Roettgers, Janko (2018-02-21). "Porn Producers Offer to Help Hollywood Take Down Deepfake Videos" (in en-US). Variety. https://variety.com/2018/digital/news/deepfakes-porn-adult-industry-1202705749/. 
  4. Goggin, Benjamin. "From porn to 'Game of Thrones': How deepfakes and realistic-looking fake videos hit it big". https://www.businessinsider.com/deepfakes-explained-the-rise-of-fake-realistic-videos-online-2019-6. 
  5. Lee, Dave (2018-02-03). "'Fake porn' has serious consequences" (in en-GB). https://www.bbc.com/news/technology-42912529. 
  6. 6.0 6.1 Cole, Samantha (2018-06-19). "Gfycat's AI Solution for Fighting Deepfakes Isn't Working" (in en). https://www.vice.com/en_us/article/ywe4qw/gfycat-spotting-deepfakes-fake-ai-porn. 
  7. "The State of Deepfake - Landscape, Threats, and Impact" (in en-US). Deeptrace. 2019-10-01. https://regmedia.co.uk/2019/10/08/deepfake_report.pdf. 
  8. 8.0 8.1 Cole, Samantha (11 December 2017). "AI-Assisted Fake Porn Is Here and We're All Fucked". https://www.vice.com/en_us/article/gydydm/gal-gadot-fake-ai-porn. 
  9. 9.0 9.1 Cole, Samantha (2018-01-24). "We Are Truly Fucked: Everyone Is Making AI-Generated Fake Porn Now" (in en). https://www.vice.com/en_us/article/bjye8a/reddit-fake-porn-app-daisy-ridley. 
  10. Cole, Samantha (2019-06-11). "This Deepfake of Mark Zuckerberg Tests Facebook's Fake Video Policies" (in en). https://www.vice.com/en_us/article/ywyxex/deepfake-of-mark-zuckerberg-facebook-fake-video-policy. 
  11. 11.0 11.1 11.2 Cole, Samantha (2018-02-06). "Pornhub Is Banning AI-Generated Fake Porn Videos, Says They're Nonconsensual" (in en). https://www.vice.com/en_us/article/zmwvdw/pornhub-bans-deepfakes. 
  12. 12.0 12.1 Cole, Samantha (2018-01-31). "AI-Generated Fake Porn Makers Have Been Kicked Off Their Favorite Host" (in en). https://www.vice.com/en_us/article/vby5jx/deepfakes-ai-porn-removed-from-gfycat. 
  13. 13.0 13.1 Cole, Samantha; Maiberg, Emanuel; Koebler, Jason (26 June 2019). "This Horrifying App Undresses a Photo of Any Woman with a Single Click". https://www.vice.com/en_us/article/kzm59x/deepnude-app-creates-fake-nudes-of-any-woman. Retrieved 2 July 2019. 
  14. 14.0 14.1 14.2 Cole, Samantha (2018-02-06). "Twitter Is the Latest Platform to Ban AI-Generated Porn" (in en). https://www.vice.com/en_us/article/ywqgab/twitter-bans-deepfakes. 
  15. Böhm, Markus (2018-02-07). ""Deepfakes": Firmen gehen gegen gefälschte Promi-Pornos vor". Spiegel Online. https://www.spiegel.de/netzwelt/web/deepfakes-online-plattformen-wollen-fake-promi-pornos-loeschen-a-1192170.html. 
  16. barbara.wimmer. "Deepfakes: Reddit löscht Forum für künstlich generierte Fake-Pornos" (in de). https://futurezone.at/digital-life/deepfakes-reddit-loescht-forum-fuer-kuenstlich-generierte-fake-pornos/400003061. 
  17. online, heise. "Deepfakes: Auch Reddit verbannt Fake-Porn" (in de). https://www.heise.de/newsticker/meldung/Deepfakes-Auch-Reddit-verbannt-Fake-Porn-3962987.html. 
  18. "Reddit verbannt Deepfake-Pornos - derStandard.de" (in de-AT). https://www.derstandard.at/story/2000073855676/reddit-verbannt-deepfake-pornos. 
  19. Robertson, Adi (2018-02-07). "Reddit bans 'deepfakes' AI porn communities" (in en). https://www.theverge.com/2018/2/7/16982046/reddit-deepfakes-ai-celebrity-face-swap-porn-community-ban. 
  20. 20.0 20.1 Kharpal, Arjun (2018-02-08). "Reddit, Pornhub ban videos that use A.I. to superimpose a person's face over an X-rated actor". CNBC. https://www.cnbc.com/2018/02/08/reddit-pornhub-ban-deepfake-porn-videos.html. 
  21. 21.0 21.1 21.2 "Scarlett Johansson on fake AI-generated sex videos: 'Nothing can stop someone from cutting and pasting my image'". The Washington Post. 2018-12-31. https://www.washingtonpost.com/technology/2018/12/31/scarlett-johansson-fake-ai-generated-sex-videos-nothing-can-stop-someone-cutting-pasting-my-image. Retrieved 2019-06-19. 
  22. Cox, Joseph (July 9, 2019). "GitHub Removed Open Source Versions of DeepNude". Vice Media. https://www.vice.com/en_us/article/8xzjpk/github-removed-open-source-versions-of-deepnude-app-deepfakes. 
  23. "pic.twitter.com/8uJKBQTZ0o". 27 June 2019. https://twitter.com/deepnudeapp/status/1144307316231200768. 
  24. 24.0 24.1 Ghoshal, Abhimanyu (2018-02-07). "Twitter, Pornhub and other platforms ban AI-generated celebrity porn" (in en-us). https://thenextweb.com/insider/2018/02/07/twitter-pornhub-and-other-platforms-ban-ai-generated-celebrity-porn/. 
  25. Hathaway, Jay (8 February 2018). "Here's where 'deepfakes,' the new fake celebrity porn, went after the Reddit ban". https://www.dailydot.com/unclick/deepfake-sites-reddit-ban/. 
  26. Gilmer, Damon Beres and Marcus. "A guide to 'deepfakes,' the internet's latest moral crisis" (in en). https://mashable.com/2018/02/02/what-are-deepfakes/. 
  27. Price, Rob (2018-01-27). "Discord just shut down a chat group dedicated to sharing porn videos edited with AI to include celebrities" (in en). https://www.businessinsider.com.au/discord-closes-down-deepfakes-server-ai-celebrity-porn-2018-1. 
  28. "Twitter bans 'deepfake' AI-generated porn" (in en). https://www.engadget.com/2018/02/07/twitter-joins-those-banning-deepfake-ai-porn/. 
  29. Harrell, Drew. "Fake-porn videos are being weaponized to harass and humiliate women: 'Everybody is a potential target'". https://www.washingtonpost.com/technology/2018/12/30/fake-porn-videos-are-being-weaponized-harass-humiliate-women-everybody-is-potential-target.