All Available Checkpoints
All checkpoints are stored in safetensors format with bfloat16 precision.
Supported Tasks
These models are jointly trained on general VQA and three categories of our curated VQA tasks:
- Generation: Predicting intermediate representations such as trajectory waypoints, gripper bounding boxes, contact points/boxes, object bounding boxes (current & final), etc.
- Understanding: Multiple-choice visual reasoning about contact states, grasp poses, object grounding, trajectory selection, movement directions, etc.
- Task Planning: High-level task planning including next-step prediction, action primitive recognition, success determination, etc.
Usage
Quick Start (This Model)
from transformers import Qwen2_5_VLForConditionalGeneration, AutoProcessor
model_path = "InternRobotics/RoboInter-VLM"
model = Qwen2_5_VLForConditionalGeneration.from_pretrained(
model_path, torch_dtype="auto", device_map="auto"
)
processor = AutoProcessor.from_pretrained(model_path)
For detailed usage and inference examples, please refer to the RoboInterVLM-QwenVL codebase.
LLaVA-OneVision Checkpoint
For loading and inference with the LLaVA-OneVision checkpoint, please refer to the RoboInterVLM-LLaVAOV codebase, as it requires custom model classes.
Training & Evaluation
For full training and evaluation pipelines, please refer to:
Citation
If you find RoboInter useful in your research, please consider citing:
@article{li2026robointer,
title={RoboInter: A Holistic Intermediate Representation Suite Towards Robotic Manipulation},
author={Li, Hao and Wang, Ziqin and Ding, Zi-han and Yang, Shuai and Chen, Yilun and Tian, Yang and Hu, Xiaolin and Wang, Tai and Lin, Dahua and Zhao, Feng and Liu, Si and Pang, Jiangmiao},
journal={arXiv preprint arXiv:2602.09973},
year={2025}
}
License
Please refer to the original licenses of RoboInter, Qwen2.5-VL, and LLaVA-OneVision.