GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
renatoschust
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
renatoschust
Model Tree
Qwen/Qwen3.5-35B-A3B
Input Modalities
Output Modalities
Supported Functionality
| Base model | Qwen/Qwen3.5-35B-A3B |
| PEFT type | LoRA (fused-expert MoE LoRA) |
| r / alpha / dropout | 16 / 16 / 0 |
| Target | attention + MLP (incl. MoE expert projections), text/language stack |
| Task | CAUSAL_LM |
| Trained with | transformers + trl + peft + unsloth |
python
from transformers import AutoModelForCausalLM, AutoTokenizerfrom peft import PeftModelimport torch base = "Qwen/Qwen3.5-35B-A3B"tok = AutoTokenizer.from_pretrained(base)model = AutoModelForCausalLM.from_pretrained(base, torch_dtype=torch.bfloat16, device_map="auto")model = PeftModel.from_pretrained(model, "renatoschust/gama-agent-lora")model = model.merge_and_unload()model.save_pretrained("gama-agent-merged")tok.save_pretrained("gama-agent-merged")adapter_model.safetensors — LoRA weights (~3.7 GB)adapter_config.json — PEFT configchat_template.jinja, tokenizer*, processor_config.json — prompt template & tokenizerApache-2.0 (inherited from the base model).