World models that ignore human beliefs predict the wrong actions, new research shows

New research indicates that current world models like Sora and Genie focus solely on simulating physics, overlooking human thoughts and feelings. The new Mental World Modeling framework introduces mental variables such as beliefs and intentions, enabling even weaker language models to outperform stronger ones that do not utilize this approach. The biggest challenge lies in predicting how physical and mental states change together, which significantly impacts the models' accuracy in predicting correct actions.