arXiv cracks down on careless use of large language models in research papers
Hızlı Bakış
- arXiv is implementing stricter rules against the misuse of large language models (LLMs) in scientific papers.
- Papers with "incontrovertible evidence" of authors not checking LLM-generated content, such as hallucinated references, will result in a one-year ban and future submission requirements.
Yapay zekâ özeti
Neden Önemli?
arXiv, a major preprint repository for research in fields like computer science and math, is increasing its efforts to combat the spread of low-quality, AI-generated papers. The platform has previously implemented measures like requiring endorsements for first-time posters.
ArXiv, a widely used open repository for preprint research, is doing more to crack down on the careless use of large language models in scientific papers.
Although papers are posted to the site before they are peer-reviewed, arXiv (pronounced “archive”) has become one of the main ways that research circulates in fields like computer science and math, and the site itself has become a source of data on trends in scientific research.
ArXiv has already taken steps to combat a growing number of low-quality, AI-generated papers, for example by requiring first-time posters to get an endorsement from an established author. And after being hosted by Cornell for more than 20 years, the organization is becoming an independent nonprofit, which should allow it to raise more money to address issues like AI slop.
In its latest move, Thomas Dietterich — the chair of arXiv’s computer science section — posted Thursday that “if a submission contains incontrovertible evidence that the authors did not check the results of LLM generation, this means we can’t trust anything in the paper.”
That incontrovertible evidence could include things like “hallucinated references” and comments to or from the LLM, Dietterich said. If such evidence is found, a paper’s authors will face “a 1-year ban from arXiv followed by the requirement that subsequent arXiv submissions must first be accepted by a reputable peer-reviewed venue.”
Note that this isn’t an outright prohibition on using LLMs, but rather an insistence that, as Dietterich put it, authors take “full responsibility” for the content, “irrespective of how the contents are generated.” So if researchers copy-paste “inappropriate language, plagiarized content, biased content, errors, mistakes, incorrect references, or misleading content” directly from an LLM, then they’re still responsible for it.
Dietterich told 404 Media that this will be a “one-strike” rule, but moderators must flag the issue and section chairs must confirm the evidence before imposing the penalty. Authors will also be able to appeal the decision.
Bundan Sonra Ne Olabilir?
Yapay zekâ öngörüsü — kesinlik taşımaz
arXiv will face challenges in consistently and fairly enforcing the new policy due to the subjective nature of "incontrovertible evidence."
Muhtemel · Aylar içinde
The new policy will lead to a decrease in the number of AI-generated papers with unchecked content on arXiv.
Muhtemel · Aylar içinde
Açık Sorular
- How will moderators effectively identify "incontrovertible evidence" of authors not checking LLM results?
- What is the appeals process for authors facing the ban?
- What specific criteria will be used to define "reputable peer-reviewed venue" for subsequent submissions?
- What is the expected volume of papers that will be flagged under this new policy?
