Artificial intelligence content detection

From HandWiki
Short description: Software to detect AI-generated content
Artificial intelligence
Major goals
Approaches
Philosophy
History
Technology
Glossary

Artificial intelligence detection software aims to determine whether some content (text, image, video or audio) was generated using artificial intelligence (AI).

As of 2023, the main examples of this are software like GPTZero, which claims to detect if text has been created by artificial intelligence and is sometimes used in colleges and universities to prevent student plagiarism. However, the reliability of such software is a topic of debate,[1] and there are concerns about the potential misapplication of AI detection software by educators.

Accuracy issues

Multiple AI detection tools have been demonstrated to be unreliable in terms of accurately and comprehensively detecting AI-generated text. In a study conducted by Weber-Wulff et al., and published in 2023, researchers evaluated 14 detection tools including Turnitin and GPT Zero, and found that "all scored below 80% of accuracy and only 5 over 70%."[2]

Text detection

For text, this is usually done to prevent alleged plagiarism, often by detecting repetition of words as telltale signs that a text was AI-generated (including AI hallucinations). They are often used by teachers marking their students, usually on an ad hoc basis. Following the release of ChatGPT and similar AI text generative software, many educational establishments have issued policies against the use of AI by students.[3] AI text detection software is also used by those assessing job applicants, as well as online search engines.[4]

Current detectors may sometimes be unreliable and have incorrectly marked work by humans as originating from AI[5][6][7] while failing to detect AI-generated work in other instances.[8] MIT Technology Review said that the technology "struggled to pick up ChatGPT-generated text that had been slightly rearranged by humans and obfuscated by a paraphrasing tool".[9] AI text detection software has also been shown to discriminate against non-native speakers of English.[4]

Two students from the University of California, Davis, nearly faced expulsion after their professors scanned their essays with a text detection tool called Turnitin, which flagged the essays as having been generated by AI. However, following media coverage,[10] and a thorough investigation, the students were cleared of any wrongdoing.[11][12]

In April 2023, Cambridge University and other members of the Russell Group of universities in the United Kingdom opted out of Turnitin's AI text detection tool, after expressing concerns it was unreliable.[13] The University of Texas at Austin opted out of the system six months later.[14]

In May 2023, a professor at Texas A&M University–Commerce used ChatGPT to detect whether his students' content was written by it, which ChatGPT said was the case. As such, he threatened to fail the class despite ChatGPT not being able to detect AI-generated writing.[15] No students were prevented from graduating because of the issue, and all but one student (who admitted to using the software) were exonerated from accusations of having used ChatGPT in their content.[16]

Anti text detection

There is software available designed to bypass AI text detection.[17]

In August 2023, a study was conducted by Taloni, et al. at Magna Græcia University and the Royal College of Ophthalmologists, to test AI text detection.[18] The study tested an AI detection tool called Originality.ai, and found it detected GPT-4 with a mean accuracy of 91.3%.[19][20]

However, when the tool was reprocessed the tool through another software called Undetectable.ai, the detection accuracy of Originality.ai dropped to a mean accuracy of 27.8%.[18][7]

The study by Taloni et Al analyzed 20 abstracts from papers published in the Eye Journal, which were then paraphrased using GPT-4.0. The AI-paraphrased abstracts were examined using QueText to check for plagiarism, and Originality.AI to check for AI-generated content. The texts were then re-processed through an adversarial software called Undetectable.ai in an attempt to reduce the AI-detection scores.[18][21][22]

Some experts also believe that techniques like digital watermarking are ineffective because they can be removed or added to trigger false positives.[23]

Image, video, and audio detection

Several purported AI image detection software exist, to detect AI-generated images (for example, those originating from Midjourney or DALL-E). They are not completely reliable.[24][25]

Others claim to identify video and audio deepfakes, but this technology is also not fully reliable yet either.[26]

Despite debate around the efficacy of watermarking, Google DeepMind is actively developing a detection software called SynthID, which works by inserting a digital watermark that is invisible to the human eye into the pixels of an image.[27][28]

See also

References

  1. ↑ "'Don't use AI detectors for anything important,' says the author of the definitive 'AI Weirdness' blog. Her own book failed the test" (in en). https://fortune.com/2023/07/03/janelle-shane-ai-weirdness-dont-use-detectors-for-anything-important/. 
  2. ↑ Weber-Wulff, Debora; Anohina-Naumeca, Alla; Bjelobaba, Sonja; Foltýnek, Tomáš; Guerrero-Dib, Jean; Popoola, Olumide; Šigut, Petr; Waddington, Lorna (2023-12-25). "Testing of detection tools for AI-generated text" (in en). International Journal for Educational Integrity 19 (1): 26. doi:10.1007/s40979-023-00146-z. ISSN 1833-2595. https://doi.org/10.1007/s40979-023-00146-z. 
  3. ↑ Hern, Alex (31 December 2022). "AI-assisted plagiarism? ChatGPT bot says it has an answer for that". The Guardian. https://www.theguardian.com/technology/2022/dec/31/ai-assisted-plagiarism-chatgpt-bot-says-it-has-an-answer-for-that. 
  4. ↑ 4.0 4.1 Sample, Ian (10 July 2023). "Programs to detect AI discriminate against non-native English speakers, shows study". The Guardian. https://www.theguardian.com/technology/2023/jul/10/programs-to-detect-ai-discriminate-against-non-native-english-speakers-shows-study. 
  5. ↑ Fowler, Geoffrey A. (2 June 2023). "Detecting AI may be impossible. That's a big problem for teachers.". The Washington Post. https://www.washingtonpost.com/technology/2023/06/02/turnitin-ai-cheating-detector-accuracy/. 
  6. ↑ Tangermann, Victor (9 January 2023). "There's a Problem With That App That Detects GPT-Written Text: It's Not Very Accurate". Futurism. https://futurism.com/gptzero-accuracy. 
  7. ↑ 7.0 7.1 "We tested a new ChatGPT-detector for teachers. It flagged an innocent student.". The Washington Post. 1 April 2023. https://www.washingtonpost.com/technology/2023/04/01/chatgpt-cheating-detection-turnitin/. 
  8. ↑ Taylor, Josh (1 February 2023). "ChatGPT maker OpenAI releases 'not fully reliable' tool to detect AI generated content". The Guardian. https://www.theguardian.com/technology/2023/feb/01/chatgpt-maker-openai-releases-ai-generated-content-detection-tool. 
  9. ↑ Williams, Rhiannon (7 July 2023). "AI-text detection tools are really easy to fool". MIT Technology Review. https://www.technologyreview.com/2023/07/07/1075982/ai-text-detection-tools-are-really-easy-to-fool/. 
  10. ↑ "AI Detection Apps Keep Falsely Accusing Students of Cheating". https://futurism.com/ai-plagiarism-software-false-accusing-students. 
  11. ↑ Jimenez, Kayla. "Professors are using ChatGPT detector tools to accuse students of cheating. But what if the software is wrong?" (in en-US). https://www.usatoday.com/story/news/education/2023/04/12/how-ai-detection-tool-spawned-false-cheating-case-uc-davis/11600777002/. 
  12. ↑ Klee, Miles (2023-06-06). "She Was Falsely Accused of Cheating With AI -- And She Won't Be the Last" (in en-US). https://www.rollingstone.com/culture/culture-features/student-accused-ai-cheating-turnitin-1234747351/. 
  13. ↑ Staton, Bethan (3 April 2023). "Universities express doubt over tool to detect AI-powered plagiarism". Financial Times. https://www.ft.com/content/d872d65d-dfd0-40b3-8db9-a17fea20c60c. 
  14. ↑ Carter, Tom. "Some universities are ditching AI detection software amid fears students could be falsely accused of cheating by using ChatGPT" (in en-US). https://www.businessinsider.com/universities-ditch-ai-detectors-over-fears-students-falsely-accused-cheating-2023-9. 
  15. ↑ Verma, Prashnu (18 May 2023). "A professor accused his class of using ChatGPT, putting diplomas in jeopardy". The Washington Post. https://www.washingtonpost.com/technology/2023/05/18/texas-professor-threatened-fail-class-chatgpt-cheating/. 
  16. ↑ "College instructor put on blast for accusing students of using ChatGPT". NBC News. 18 May 2023. https://www.nbcnews.com/tech/chatgpt-texas-college-instructor-backlash-rcna84888. 
  17. ↑ Beam, Christopher. "The AI Detection Arms Race Is On—and College Students Are Building the Weapons" (in en-US). Wired. ISSN 1059-1028. https://www.wired.com/story/ai-detection-chat-gpt-college-students/. 
  18. ↑ 18.0 18.1 18.2 Taloni, Andrea; Scorcia, Vincenzo; Giannaccare, Giuseppe (2023-08-02). "Modern threats in academia: evaluating plagiarism and artificial intelligence detection scores of ChatGPT" (in en). Eye: 1–4. doi:10.1038/s41433-023-02678-7. ISSN 1476-5454. https://www.nature.com/articles/s41433-023-02678-7. 
  19. ↑ Wiggers, Kyle (2023-02-16). "Most sites claiming to catch AI-written text fail spectacularly" (in en-US). https://techcrunch.com/2023/02/16/most-sites-claiming-to-catch-ai-written-text-fail-spectacularly/. 
  20. ↑ "AI Content Checker and Plagiarism Check | GPT-4 | ChatGPT". https://originality.ai/. 
  21. ↑ "The Truly Undetectable AI Content Writing Tool" (in en). https://undetectable.ai/. 
  22. ↑ Thompson, David.(13 Dec 2023). Researchers Say Undetectable.ai Is A Modern Threat To Academia Science Times. Retrieved 13 Dec 2023
  23. ↑ Knibbs, Kate. "Researchers Tested AI Watermarks—and Broke All of Them" (in en-US). Wired. ISSN 1059-1028. https://www.wired.com/story/artificial-intelligence-watermarking-issues/. 
  24. ↑ Thompson, Stuart A.; Hsu, Tiffany (28 June 2023). "How Easy Is It to Fool A.I.-Detection Tools?". The New York Times. https://www.nytimes.com/interactive/2023/06/28/technology/ai-detection-midjourney-stable-diffusion-dalle.html. 
  25. ↑ Rizwan, Choudhury (October 15, 2023). "Expert debunks AI tool's claim that Israel’s photo is fake". Interesting Engineering. https://interestingengineering.com/culture/expert-debunks-ai-tools-claim-that-israels-photo-is-fake. 
  26. ↑ Hsu, Tiffany; Myers, Steven Lee (18 May 2023). "Another Side of the A.I. Boom: Detecting What A.I. Makes". The New York Times. https://www.nytimes.com/2023/05/18/technology/ai-chat-gpt-detection-tools.html. 
  27. ↑ Pierce, David (2023-08-29). "Google made a watermark for AI images that you can't edit out". https://www.theverge.com/2023/8/29/23849107/synthid-google-deepmind-ai-image-detector. 
  28. ↑ Wiggers, Kyle (2023-08-29). "DeepMind partners with Google Cloud to watermark AI-generated images". https://techcrunch.com/2023/08/29/deepmind-partners-with-google-cloud-to-watermark-ai-generated-images/. 



Retrieved from "https://handwiki.org/wiki/index.php?title=Artificial_intelligence_content_detection&oldid=3431495"