Research

Publications

Beyond Static Vision: Scene Dynamic Field Unlocks Intuitive Physics Understanding in Multi-modal Large Language Models

Nanxi Li, Xiang Wang, Yuanjie Chen, Haode Zhang, Hong Li, Yong-Lu Li

Published in ICLR, 2026

We identify a critical gap in MLLMs’ physics comprehension and propose Scene Dynamic Field, integrating physics simulators into a fine-tuning framework. Our method achieves up to 20.7% gains on fluid tasks while generalizing to unfamiliar physical domains. Paper Code

The Labyrinth of Links: Navigating the Associative Maze of Multi-modal LLMs

Hong Li, Nanxi Li, Yuanjie Chen, Jianbin Zhu, Qinlu Guo, Cewu Lu, Yong-Lu Li

Published in ICLR, 2025

In this paper, we first devise a standard association benchmark based on adjective and verb association semantic concepts. Instead of costly data annotation and organization, we propose a convenient annotation-free reconstruction method transforming the general dataset for our association tasks. Furthermore, we comprehensively investigate the MLLMs’s ability and potential for association ability. Project Code Paper