A clever series of experiments by computer scientists and engineers at Stanford University indicate that her labors to vet each essay five ways might be in vain. The researchers demonstrated how seven commonly used GPT detectors are so primitive that they are both easily fooled by machine generated essays and improperly flagging innocent students. Layering several detectors on top of each other does little to solve the problem of false negatives and positives.
“If AI-generated content can easily evade detection while human text is frequently misclassified, how effective are these detectors truly?” the Stanford scientists wrote in a July 2023 paper, published under the banner, “opinion,” in the peer-reviewed data science journal Patterns. “Claims of GPT detectors’ ‘99% accuracy’ are often taken at face value by a broader audience, which is misleading at best.” ...
Full story at https://hechingerreport.org/proof-points-its-easy-to-fool-chatgpt-detectors/.
In the end, we're just going to have to maintain a sense of humor about these developments:
Source: https://twitter.com/CalPolicy/status/1658536300906172417.
No comments:
Post a Comment