The checkpoint uses the native Qwen3.5 XML tool-call format. A typical call has the following shape:
<tool_call>
<function=Read>
<parameter=file_path>/testbed/package/module.py</parameter>
</function>
</tool_call>
Do not convert this checkpoint to a legacy Hermes JSON tool-call template at inference time. Use the included tokenizer and chat_template.jinja.
Training summary
- Base model: Qwen/Qwen3.5-4B
- Training method: LoRA supervised fine-tuning, merged into the base model
- Teacher models: DeepSeek-V4-Flash, DeepSeek-V4-Pro
- Domain: executable software-engineering agent trajectories
- Environment: SWE-Gym repositories with a Claude-Code-compatible tool interface
- Data filtering: execution-verifier-positive trajectories only
- Training framework: MS-SWIFT
- Precision: BF16
- LoRA rank: 32
- LoRA alpha: 64
- Context length used for SFT: 32,768 tokens
- Packing: disabled
Tool outputs and environment responses were retained as conversation context but were not intended as model-generated supervision. The supervised targets are assistant turns, including native Qwen3.5 tool calls and final responses.
Use a recent Transformers release with Qwen3.5 support.
from transformers import AutoModelForImageTextToText, AutoProcessor
model_id = "6cf/Qwen3.5-4B-SWE-SFT-Coldstart"
processor = AutoProcessor.from_pretrained(
model_id,
trust_remote_code=True,
)
model = AutoModelForImageTextToText.from_pretrained(
model_id,
torch_dtype="auto",
device_map="auto",
trust_remote_code=True,
)
For text-only agent inference, the same processor and model can be used with a text conversation and tool schemas passed through the included chat template.