Study: Rapid LLM Development Outpaces Research Explanations

Stanford researchers evaluated 50 widely cited claims about large language models (LLMs) against 20 current models. The findings revealed that 44% of these claims are already "expired," while another 34% have significantly weakened. The average lifespan of these claims is just 15.7 months, with those about what models cannot do expiring the fastest.