lab21-qwen3.5-9b-triage-vi-lora
LoRA adapter fine-tuned for Vietnamese customer-support ticket triage → 4-field
JSON (intent, urgency, product, sentiment). Lab 21 (AICB-P2T3 Day 21,
Track 3), student submission.
- Base:
Qwen/Qwen3.5-9B (bf16) · placement text-linear (12 module types, vision
tower excluded) · r=16 · alpha=32 · LR 1e-4 · 30 optimizer steps · loss mask
assistant-only (verified by decoding the supervised span).
- Measured (n=50, greedy): target 0.990 vs optimized-prompt baseline 0.815,
format 1.000 — but regression 0.742 → 0.133: catastrophic forgetting on
general Vietnamese instructions. The lab's regression gate verdict is FAILED;
this adapter is published as a lab artifact, not as a deployment-ready model.
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3.5-9B", dtype="bfloat16", device_map="auto")
tok = AutoTokenizer.from_pretrained("Qwen/Qwen3.5-9B")
model = PeftModel.from_pretrained(base, "AnVu10/lab21-qwen3.5-9b-triage-vi-lora")