GPT and Claude failed Bridgewater's finance tests because the right answers were never public

Bridgewater and Thinking Machines Lab report that a finely tuned open-weight model outperforms leading AI models in evaluating financial documents. Their analysis shows this model achieves superior results at a significantly lower cost. The findings reveal that models like GPT and Claude failed Bridgewater's finance tests due to the lack of publicly available correct answers. This highlights the critical role of accessible data in assessing model performance.