AI agents can't yet do open-ended AI research

Leading AI labs aim for recursive self-improvement (RSI), which involves automating AI research through AI agents. Over the past year, evaluations have shown that agents can make progress on easily verifiable tasks, raising speculation about nearing this milestone. However, these evaluations are limited to narrow tasks, while AI research often requires testing new hypotheses.