Can readers tell human writing from AI anymore?
- In the Bot or Not test built by forensic linguist Claire Hardaker of the University of Lancaster, most people identify AI-generated text in about nine of fifteen passages, sixty percent, barely better than a coin toss.
- The old giveaways of machine prose, clumsy syntax and repetition, are gone; detection now rests on subtler patterns such as sentence rhythm, statistically likely word choices and an unusually smooth tone.
- Even apparent human touches can be faked, since a model trained to mimic our imperfections can manufacture a stray typo or an ungrammatical aside on demand.
- AI has already written novels in limited and experimental forms; the open question is whether the literary world will build the norms, tools and critical vocabulary to meet the moment.
Show most people fifteen short passages and ask which ones a machine wrote, and they get about nine right. Sixty percent. Barely better than a coin toss. That figure comes from Bot or Not, an online test built by Claire Hardaker, a forensic linguist at the University of Lancaster, and it is the quiet, unsettling centre of a recent Guardian piece on whether AI could write the next great novel, and whether anyone would clock it if it did.
The boundary between human and machine prose, it turns out, is far more porous than most readers assume. This is not a worry confined to technical journals. Allegations of undisclosed LLM use have already blown up in literary and media circles, dragging authenticity, attribution, and the value we place on human creative labour into the open.
Detection is hard now because the old giveaways are gone. Early models tripped over clumsy syntax and repeated themselves. Today’s do not. Hardaker’s research points instead to subtler patterns: particular rhythms in how sentences are built, word choices that are just a little too statistically likely, a smoothness of tone that readers can sometimes feel but rarely name. Even the human touches can be faked. A stray typo or an ungrammatical aside looks like fallibility, but a model trained to mimic our imperfections can manufacture it on demand.
The stakes reach well past prize committees. If readers cannot reliably tell human prose from machine prose, the whole social contract around creative writing starts to move. Jennifer Egan and Jeanette Winterson both weigh in, turning the question over: what does fiction mean when ChatGPT can spin plausible narrative in seconds? Their point is less technical than philosophical. What is it we actually value in literature, and does it matter where the words came from if the experience of reading them does not change?
That is the real tension, between what a model can do and what the doing means. Large language models can produce coherent, sometimes elegant prose. They hold a narrative voice, manage pacing, deploy the usual literary machinery. What nobody can yet say is whether they can write something that genuinely moves a reader, that catches something true about a mind or a society, or whether it all amounts to a very sophisticated pastiche: recombinant, not revelatory.
So the open question is not whether AI will write novels. It already has, in limited and experimental forms. The question is whether the literary world will build the norms, the tools, and the critical vocabulary to meet the moment. Detection will get better. So will generation. This particular arms race, between authenticity and simulation, is only getting started.