started · updated
AI research reveals accuracy risks and implementation complexities
Research from the University of Southern Denmark highlights significant limitations in how Large Language Models (LLMs) handle outdated information. A study analyzing 317 cases across medicine, law, software development, and platform rules found that AI systems often fail to identify expired facts, leading to distorted answers. Error rates for incorrect responses due to outdated sources ranged from 17% to 91%, with the medical field showing the highest vulnerability.
Even advanced architectures like GPT-5.5 were affected, with 74 out of 83 previously correct medical answers being compromised by outdated documents. When models were instructed to strictly follow provided documentation, error rates rose significantly, reaching 75% for Qwen2.5-7B and 66% for Llama-3.1-8B in medical contexts.
Parallel to these accuracy concerns, the strategic implementation of AI in business remains complex. Companies can utilize LLMs through five primary methods: public standard models, contractually secured enterprise solutions, models with access to internal knowledge, self-operated/customized models, or fully self-developed foundational models. The choice between these methods involves critical trade-offs regarding data sovereignty, privacy, dependency, and cost.
Entities
GPT-5.5 · Llama-3.1-8B · Qwen2.5-7B · University of Southern Denmark