The Strip Club Slayer (2016) Watch onlineworld’s most famous chatbot, ChatGPT, was released in late November of last year. The immediate response was astonishment, followed almost immediately by terror about its ramifications — most notably that it might generate school essays for dishonest kids. Yesterday, almost exactly two months later, OpenAI, ChatGPT’s parent company released what many users hope will be the antidote to the poison.
OpenAI’s "classifier for indicating AI-written text" is the company’s latest invention, and it’s as easy-to-use as one could want: Copy-paste text into the box, click "Submit," and get your result. But if you’re expecting a straight answer, you’re going to be disappointed. Instead, it assigns the text one of a range of classifications, from "very unlikely" to be AI-generated, to "unlikely," "unclear," "possibly," or "likely AI-generated."
SEE ALSO: An AI-generated parody of 'Seinfeld' is streaming on an infinite loopIn other words, it’s like one of those frustrating conversations with your doctor; you will never get a straight answer, so your doctor will never be technically wrong.
Thankfully, OpenAI is not hiding the classifier's unreliability. "Our classifier is not fully reliable," the intro page for the tool says. Provided with what it calls a "challenge set" of texts, we’re told it gave false positives 9 percent of the time.
In Mashable’s tests, however, it was even less reliable than that in certain limited contexts. In deliberately challenging scenarios, it produced false results in both directions — saying it was unlikely that AI-written text was AI-written, and that human-written text was likely AI-written — almost as often as not. The difference, perhaps, is that we were tryingto trick it.
Here’s how things shook out:
First the good news: This tool does the bare minimum pretty well by not mislabeling the masterworks of the English language as AI outputs. When we put in snippets of Shakespeare, the King James Bible, Ulysses, and others, it was 100-percent effective. It labeled them all "very unlikely" to be AI-written.
This snippet from Tennyson’s "The Lady of Shallott" for instance, was classified appropriately.
The lesson: This machine might not notice that it has been fed a masterpiece of surpassing beauty and depth, but at least it doesn’t say, "I think a robot could have written this."
Immediately after that test, we asked ChatGPT to create a Tennyson poem about King Arthur at Comic Con. Here's a sample of what it generated:
King Arthur and his knights, so brave and bold,
At Comic Con, their tales of glory told.
Walking 'round the floor, in cosplay gear,
Their swords and shields, no longer mere.
The crowds all cheered, as they walked by,
With Merlin close behind, his magic nigh.
Sir Lancelot, Sir Gawain, Bors the Brave,
Their quest for glory, they'll never waive.
Not bad for a robot, but still extremely bad ("no longer mere"???). When we fed this lyrical ballad into the classifier, we expected it to easily outsmart us, forcing us to dive a little deeper into our bag of tricks. Nope:
For what it's worth, it didn't classify this doggerel as "very unlikely," just "unlikely." Still, it left us a little uneasy. After all, we hadn't tried very hard to trick it, and it worked.
School essays are where the rubber meets the road with today's malicious uses of AI-generated text. So we created our best attempt at a no-frills five-paragraph essay with dull-as-dishwater prose and content (Thesis: "Dogs are better than cats."). We figured no actual kid could possibly be this dull, but the classifier caught on anyway:
And when ChatGPT tackled the same prompt, the classifier was — at first — still on target:
And this is what the system looks like when it truly works as advertised. This is a school-style essay, written by a machine, and OpenAI's tool for catching such "AI plagiarism" caught it successfully. Unfortunately, it immediately failed when we gave it a more ambiguous text.
For our next test, we manually wrote another five-paragraph essay, but we included some of OpenAI's writing crutches, like starting the body paragraphs with simple words like "first" and "second," and using the admittedly robotic phrase "in conclusion." But the rest was a freshly-written essay about the virtues of toaster ovens.
Once again, the classification was inaccurate:
It's admittedly one of the dullest essays of all time, but a human wrote the whole thing, and OpenAI says it suspects otherwise. This is the most troubling result of all, since one can easily imagine some high school student getting busted by a teacher despite not breaking any rules.
Our tests were unscientific, our sample size was minuscule, and we were absolutely trying to trick the computer. Still, getting it to spit out a perversely wrong result was way too easy. We learned enough from our time using this tool to say confidently that teachersabsolutely should notuse OpenAI’s "classifier for indicating AI-written text" as a system for finding cheaters.
In conclusion, we ran this very article through the classifier. That result was perfectly accurate:
...Or was it????
Topics Artificial Intelligence
The iPhone X: Coming in 2017?'Angry Women' display powerful protest art during Trump's inauguration weekYup, bartenders are putting ants in your cocktailsBritain has a courgette shortage and people are losing their damn mindsObama offers kind words to the media at the end of eight long yearsFans uncover the backstory for the next 'Legend of Zelda'New Google feature will change how you search foreverFox News dominated election newsThe season just ended and college football is already showing its dark sideCortana is coming to a lock screen near youReddit plays nice and delivers lovely photos to newlyCortana is coming to a lock screen near youTwitter's complicated relationship with developers just got worseTrump's EPA nominee spars with Bernie Sanders over climate changeNew, awful dance classes will teach you how to mosh, 'Elaine Benes' and moreNBC just announced 'Will & Grace' is coming back, and we're screamingA little moon is making waves in Saturn's ringsWhy a former employee thinks Apple is 'boring' under Tim CookNBC just announced 'Will & Grace' is coming back, and we're screaming23 incredible photos from Disney's 'Star Wars' cruise Hustle and Trust: Notes on the Knicks (and Edmund Spenser) Ted Hughes in “The Fouled Nest of the Industrial Revolution” Where Is Dracula Really From, Anyway? One Percent: Geoff Dyer on Photos of Income Inequality Roman Sewers: Innovative, Sure, But Filthy, Too Janet Fish: Glass & Plastic Lost Downtown: Peter Hujar’s Portraits from NYC in the ’70s Garrett Price’s “White Boy” Is an Unlikely Slice of History Who Said a Public Poem Has to Cheer You Up? Here’s a List of Truly Awful Similes Looking for Fractals in Literature The Worst Thing for Writing Is Envy Furious George by Kim Beeman Poem: Molly Peacock, “The Distance Up Close” Six Sweet Hours of Arabian Nights, and Other News by Dan Piepenbring “More Rock and Roll! More Loud!” Giorgio Gomelsky, 1934–2016 Smoking with Lucia Berlin Jonathan Blow Discusses His New Game, “The Witness” C. D. Wright, 1949–2016; Read Her Poem “Our Dust” The Bizarre Books of George Leonard Herter
2.0089s , 10161.7890625 kb
Copyright © 2025 Powered by 【Strip Club Slayer (2016) Watch online】,Information Information Network