I'm a fourth-year Ph.D. student in Computer Science and Technology at Shanghai Jiao Tong University (SJTU),
advised by Prof. Lizhuang Ma at the Digital Media & Computer Vision Laboratory (DMCV),
with additional supervision from Dr. Xin Tan.
Before my Ph.D., I received my bachelor's degree in Computer Science and Technology from Beihang University (BUAA).
My research interests involve multimodal large language models (MLLM / VLM) and 3D vision.
I'm currently interested in VLM post-training and agentic RL, particularly in advancing the capabilities of foundation models for Computer-use Agents & Design Artifacts.
I have previously conducted some work in 2D/3D scene understanding, especially in scene parsing and 3D Gaussian splatting.
A framework for safe and trustworthy embodied AI, defining five levels and ten core principles, analyzing risks across the agent's operational stages, and outlining a roadmap toward safety across the closed-loop interaction between agents and their environments.
An active exploration framework that enables VLMs to actively explore 3D worlds and lifts VLMs from passive view-centric perception to active world-centric spatial reasoning.
An exemplar-driven framework that uses collaborative coding agents and geometric utilities to generate spatial question-answer pairs at scale in simulated 3D environments, improving VLMs' spatial reasoning through synthetic training data.
A feed-forward network that reconstructs language-embedded 3D Gaussians from arbitrary uncalibrated and unposed images with a compact semantic representation that avoids per-Gaussian language embedding and significantly reduces storage overhead.
A sparse-to-dense lifting pipeline that bridges point clouds and 3D Gaussian Splatting via a one-step diffusion model, enabling high-quality 3DGS reconstruction with minimal inputs.
A feed-forward Gaussian splatting model that jointly reconstructs 3D scenes and semantic fields from sparse, uncalibrated and unposed images, enabling real-time rendering and open-vocabulary segmentation.
A multimodal place recognition framework that combines feed-forward Gaussian representations with Mamba-based enhancement for mixed traffic environments.
A feed-forward Gaussian splatting model that reconstructs instance-grouped 3D scenes from sparse, unposed images and supports complex referring segmentation through scene graphs and VLM-based reasoning.
A training-free token pruning framework that calibrates attention scores and synchronizes pruning across conditioning branches for efficient multi-image synthesis in unified multimodal models, achieving up to 2.09× attention-core speedup.
A framework that reveals hidden articulation cues by synthesizing an opened state from a single static image, enabling joint estimation and part-level novel state synthesis.
A new task setting, Generalized Category Discovery in Semantic Segmentation (GCDSS), aims to discover and segment base and novel categories using labeled base-class data.
An open-source framework for infectious disease modeling with big data, enabling researchers to build subdivided, multi-stage and metapopulation models without programming.