GPTZero

Source: Wikipedia, the free encyclopedia.

GPTZero
Developer(s)Edward Tian
Alex Cui
Yazan Mimi[1]
Initial release3 January 2023; 15 months ago (2023-01-03)
Written inPython
PlatformCloud computing
Websitegptzero.me

GPTZero is an

large language models.[2][3][4][5]

While GPTZero has received positive coverage for its efforts to prevent academic dishonesty, its reported outputs of false positives has been source of criticism.[6]

History

GPTZero was developed by Edward Tian, a Princeton University undergraduate student, and launched online in January 2023 in response to concerns about AI-generated usage in academic plagiarism.[7][8] GPTZero has raised over 3.5 million dollars in seed funding.[9][10]

In the first week of its release, the GPTZero experienced 30,000 uses, which led to a crash. It is supported by the web app company Streamlit, who allocated more server resources in response.[11]

Mechanism

GPTZero uses qualities it terms perplexity and burstiness to attempt determining if a passage was written by a AI.[12] According to the company, perplexity is how random the text in the sentence is, and whether the way the sentence is constructed is unusual or "surprising" for the application. It relies on language models, and the more such models, the higher the chance that a person did not write the text.[13] In contrast, burstiness compares sentences with each other, determining their similarity. Human text is more discontinuous, meaning humans tend to write with more sentence variation than AI.[8]

News website

US Constitution, are labeled as AI-generated.[14]

Use cases and applications

The academic community has attempted using GPTZero to tackle concerns about AI-generated content for plagiarism.[15][13][12] Educational institutions, including Princeton University, have discussed the use of GPTZero to combat AI-generated content in academic settings, with mixed opinions.[8][16] In October 2023, GPTZero had partnered with the American Federation of Teachers.[17]

Efficacy

In a March 2023 a paper named "Can AI-Generated Text be Reliably Detected?",

University of Maryland demonstrate empirically and theoretically that several AI-text detectors are not reliable in practical scenarios.[19][20]

Tech website Futurism tested the tool, and said that while the "results are impressive", based on its error rate, teachers relying the tool would end up "falsely accusing nearly 20 percent of [innocent students] of academic misconduct".[21]

The Washington Post have noted GPTZero suffers from false positives, emphasizing that "even a small “false positive” error rate means that some students could be wrongly accused [of academic misconduct]".[6]

External links

  • "College student claims app can detect essays written by chatbot ChatGPT". The Guardian.

See also

References

  1. ^ "Meet the Etobicoke-born inventor of the ChatGPT detector". Toronto Life.
  2. ^ "GPTZERO: A New Tool to Detect AI-Generated Content in ChatGPT". The Washington Post.
  3. ^ "How apps like GPTZero detect content written by A.I." CNBC. July 24, 2023. Retrieved September 21, 2023.
  4. ^ "GPTZero App Seeks to Thwart AI Plagiarism in Schools, Online Media". Bloomberg.com. May 8, 2023. Retrieved October 21, 2023.
  5. ^ "American Federation of Teachers partners with AI identification platform, GPTZero". CBS News. October 17, 2023. Retrieved October 21, 2023.
  6. ^ a b Fowler, Geoffrey (August 14, 2023). "What to do when you're accused of AI cheating". The Washington Post. Retrieved October 20, 2023.
  7. ^ "How a 23-year-old college student built one of the leading AI detection tools". Business Insider. Retrieved September 21, 2023.
  8. ^ a b c "Edward Tian's GPTZERO Software Aims to Detect AI-Generated Plagiarism". The Daily Princetonian.
  9. ^ "This AI detection tool raised $3.5 million to check the internet for computer-generated work". Fast Company. 2023.
  10. ^ Shrivastava, Rashi. "With Seed Funding Secured, AI Detection Tool GPTZero Launches New Browser Plugin". Forbes. Retrieved May 17, 2023.
  11. ^ "GPTZERO: A New AI Detector Aims to Combat ChatGPT Plagiarism". NPR. January 9, 2023.
  12. ^ a b "What is GPTZERO? The ChatGPT Detection Tool Explained". Tech Learning.
  13. ^ a b "AI Detector for Educators: What is GPTZERO?". Jumpstart Magazine.
  14. ^ Edwards, Benj (July 14, 2023). "Why AI detectors think the US Constitution was written by AI". Ars Technica. Retrieved December 14, 2023.
  15. ^ Tribune.com.pk. "GPTZero: A ChatGPT Detection Tool". The Express Tribune.
  16. ^ "GPTZero to help teachers deal with ChatGPT-generated student essays". The Indian Express. January 12, 2023. Retrieved September 21, 2023.
  17. ^ "US Teachers Union Bans ChatGPT and Deploys GPTZero To Detect Cheating". MobileAppAaily. Retrieved October 21, 2023.
  18. ].
  19. . Retrieved October 21, 2023.
  20. ^ "No reliable way to detect AI-generated text, boffins sigh". The Register. March 21, 2023. Retrieved September 25, 2023.
  21. ^ "There's a Problem With That App That Detects GPT-Written Text: It's Not Very Accurate". Futurism. Retrieved October 21, 2023.