As a comparison, Cui cited another analysis that GPTZero ran on Wikipedia earlier this year, which estimated that around one in 20 articles on the site are likely AI-generated—about half the frequency of the posts GPTZero looked at on Substack.
That should be one in 20 new articles, per the story they cite, which is ultimately based on arXiv:2410.08044.
David Skilling, a sports agency CEO who runs the popular soccer newsletter Original Football (over 630,000 subscribers), told WIRED he sees AI as a substitute editor. “I proudly use modern tools for productivity in my businesses,” says Skilling.
Babe wake up, a new insufferable prick just dropped.
Edit to add: There’s an interesting example here of a dubious claim being laundered into truthiness. That arXiv preprint says this in the conclusion section.
Shao et al. (2024) have even designed a retrieval-based LLM workflow for writing Wikipedia-like articles and gathered perspectives from experienced Wikipedia editors on using it—the editors unanimously agreed that it would be helpful in their pre-writing stage.
But if we dig up arXiv:2402.14207, we find that the “unanimous” agreement depends upon lumping together “somewhat” and “strongly agree” on their Likert scale. Moreover, this grand claim rests upon a survey of a grand total of ten people. Ten people, we hasten to add, who agreed to the study in the first place, practically guaranteeing a response bias against those Wikipedians who find “AI” morally repugnant.
From the Wired story:
That should be one in 20 new articles, per the story they cite, which is ultimately based on arXiv:2410.08044.
Babe wake up, a new insufferable prick just dropped.
Edit to add: There’s an interesting example here of a dubious claim being laundered into truthiness. That arXiv preprint says this in the conclusion section.
But if we dig up arXiv:2402.14207, we find that the “unanimous” agreement depends upon lumping together “somewhat” and “strongly agree” on their Likert scale. Moreover, this grand claim rests upon a survey of a grand total of ten people. Ten people, we hasten to add, who agreed to the study in the first place, practically guaranteeing a response bias against those Wikipedians who find “AI” morally repugnant.