Introduction
AREX-2 is a 27B-parameter long-horizon agent model from the Beijing Academy of
Artificial Intelligence (BAAI). It learns to improve a solution over multiple
test-time rounds: propose, measure, reflect, and revise.
AREX-2 is trained on machine-learning and algorithmic-programming tasks with
verifiable feedback, together with the existing AREX deep-research data. The
learned self-improvement behavior transfers to deep research without adding new
search trajectories.
- Architecture: Dense Qwen3.8-compatible multimodal model
- Parameters: 27B
- Context length: 262,144 tokens
Key features
- Long-horizon self-improvement: turns extra test-time rounds into useful
solution refinement.
- Feedback-driven reflection: reads scores, logs, errors, and timings to
decide what to change next.
- Cross-domain performance: training on coding and machine-learning tasks
also improves the model's deep-research performance.
- Long-horizon reasoning: sustains productive iteration as the task budget
grows.
Evaluation
AREX-2 is evaluated on algorithmic programming, machine-learning engineering,
deep research, and general agentic reasoning. Results follow the protocols
reported in the AREX-2 paper.
Coding and machine-learning engineering
Frontier-CS is the 188-task Agent Track. MLE-Lite reports Any Medal
averaged over three seeds.
General agentic reasoning and deep research
HLE values marked * are from the full HLE set; unmarked values use the
text-only subset.
Inference
Use a recent Transformers release with Qwen3.8 support.
pip install -U torch transformers accelerate
import torchfrom transformers import AutoModelForMultimodalLM, AutoProcessor model_id = "BAAI/AREX-2"processor = AutoProcessor.from_pretrained(model_id)model = AutoModelForMultimodalLM.from_pretrained( model_id, dtype=torch.bfloat16, device_map="auto") messages = [{ "role": "user", "content": "Propose a solution and explain how you would improve it over several rounds.",}]inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt",).to(model.device) with torch.inference_mode(): outputs = model.generate(**inputs, max_new_tokens=1024)print(processor.decode( outputs[0][inputs["input_ids"].shape[-1]:], skip_special_tokens=True))
Intended use
AREX-2 is intended for research on long-horizon agents, iterative problem
solving, machine-learning engineering, algorithmic coding, and tool-augmented
deep research.
License
AREX-2 is released under the Apache License 2.0. Follow the terms
and notices for the Qwen base model and any downstream data or tools.
Citation
@misc{baai2026arex, title={AREX: Towards a Recursively Self-Improving Agent for Deep Research}, author={Lu, Shuqi and Li, Chaofan and Luo, Kun and Zhang, Zhang and Wang, Hui and Xiao, Hongwang and Xiong, Lei and Wang, Jiahao and Wang, Sen and Jiang, Xiyan and Li, Wanli and Hu, Yuyang and Qian, Hongjin and Yan, Bingyu and Xia, Ziyi and Shao, Yingxia and Liu, Kang and Dou, Zhicheng and He, Di and Li, Chaozhuo and Ye, Qiwei and Wang, Zhongyuan and Liu, Zheng}, year={2026}, eprint={2607.21461}, archivePrefix={arXiv}, primaryClass={cs.AI}, url={https://arxiv.org/abs/2607.21461}}