LLMs' Factual Recall Linked to Size

Researchers have discovered a surprising pattern in how artificial intelligence models, known as large language models, perform on factual questions. They found that the models' ability to recall true facts improves as the model gets bigger and is trained on topics that are more frequently discussed. In other words, the more information the model is trained on, the better it is at distinguishing between true and false facts. This discovery could help improve the accuracy of AI-powered tools that provide information and answer questions.