GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
starttoshow
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
starttoshow
Model Tree
Qwen/Qwen3.5-2B
Input Modalities
Output Modalities
Supported Functionality
Use PeftConfig.from_pretrained(adapter_id) to obtain the pinned base configuration, load that base with Qwen3_5ForConditionalGeneration.from_pretrained(base_id, revision=base_revision), then PeftModel.from_pretrained(base, adapter_id). The GitHub project provides python -m examples.inference --adapter starttoshow/medix-qwen3.5-2b-vqa-attention-ffn --question "Your question" from its MediX-R1 directory. Supply --image for an image question. The example defaults to CPU; GPU use is explicit.
The processor/template files are retained from training. Do not treat the model as a deployed medical service. Medical safety, clinician-level reliability, and improved end-to-end Agent performance have not been established.