GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
hxcsa
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
hxcsa
Model Tree
Qwen/Qwen3.5-4B
Input Modalities
Output Modalities
Supported Functionality
python
from unsloth import FastVisionModelfrom peft import PeftModel base, processor = FastVisionModel.from_pretrained("Qwen/Qwen3.5-4B", load_in_4bit=True)FastVisionModel.for_inference(base)model = PeftModel.from_pretrained(base, "hxcsa/qwen35-4b-docvqa-lora")FastVisionModel.for_inference(model) # Qwen3.5 is a thinking-style model — disable thinking for concise answerstext = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=False, enable_thinking=False, # ← essential)inputs = processor(images=image, text=text, add_special_tokens=False, return_tensors="pt").to("cuda")out = model.generate(**inputs, max_new_tokens=64, do_sample=False)answer = processor.decode(out[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True).strip()| Model | ANLS | Exact Match |
|---|---|---|
| Qwen3.5-4B base (zero-shot) | 0.6265 | 0.5933 |
| v1 LoRA (1k from val, contaminated) | 0.8626 | 0.8333 |
| v2 r16 attn-only (2k train, 2 epochs) | 0.8687 | 0.8567 |
| v2 r32 + MLP (2k train, 2 epochs) | 0.8833 | 0.8667 |
+0.26 ANLS over zero-shot. Clean eval (trained on train, tested on val).
Trained on hxcsa/docvqa-2k-train (2,000 samples from DocVQA train split,
quality-filtered, 1344px max edge). The validation ANLS uses the clean
DocVQA validation split.
adapter_model.safetensors — LoRA weights (34 MB)tokenizer.json / tokenizer_config.json / chat_template.jinja — Qwen3.5 templateprocessor_config.json — vision processor configfrom unsloth import FastVisionModelfrom peft import PeftModel base, processor = FastVisionModel.from_pretrained("Qwen/Qwen3.5-4B", load_in_4bit=True)FastVisionModel.for_inference(base)model = PeftModel.from_pretrained(base, "hxcsa/qwen35-4b-docvqa-lora")FastVisionModel.for_inference(model) # Qwen3.5 is a thinking-style model — disable thinking for concise answerstext = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=False, enable_thinking=False, # ← essential)inputs = processor(images=image, text=text, add_special_tokens=False, return_tensors="pt").to("cuda")out = model.generate(**inputs, max_new_tokens=64, do_sample=False)answer = processor.decode(out[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True).strip()