Hallucinated academic citations have become a hallmark of the artificial-intelligence era. But they might soon be gone for good. Researchers have found that the latest large language models (LLMs) rarely, if ever, attribute information to sources that don’t exist.

The finding is part of an analysis that reports that many LLM tendencies, such as overthinking simple maths problems and complying with illogical requests, fade over time as AI companies release new or updated models with improved capabilities. Many of these tendencies disappear about 16 months after the phenomenon is first described in a published paper. The analysis, described in a blog post, has not been peer reviewed.

“We, as users of these systems, need to not have such a fixed view of what AI can do and what it can’t do,” says co-author Owen Queen, an AI researcher at Stanford University in California.

But just because an LLM behaviour fades as models improve doesn’t mean that the effect immediately disappears, says Maxim Topaz, a health-care AI researcher at Columbia University in New York City. Topaz has found1 that the number of hallucinated citations in academic papers has risen drastically since 2023, probably because more researchers than ever before are using LLMs, and they often aren’t using the latest models.

To read more, click here.