coordinator-qwen3-14b-qlora-grounded

Training

• Data: 98 RAFT-style self-distilled examples built from the train half of a leakage-disjoint split of Legal RAG Bench (oracle passages + question -> quote-first answers), candidates filtered by the team's DeBERTa verifier (keep-top-3 by composite).
• Recipe: QLoRA r=32 on 4-bit NF4 Qwen3-14B; 128.4M trainable params (0.86%); 2 epochs, effective batch 7, 14 optimizer steps; final train loss 0.362. Single seed, single run.

Evaluation (component-level, 50 held-out items, verifier-reranked best-of-8)

Mechanism: the fine-tune eliminates the near-miss (cosmetically altered quote) failure class — content-minus-strict gap 0.163 -> 0.033 clean and 0.228 -> 0.000 under stress. Verifier support is flat (0.838 -> 0.820): the entailment channel was never the deficit. Training is worth ~one doubling of inference compute (grounded N=1 composite 0.558 ~= base N=2 0.559).

Intended use & limitations

• Format-locked: improvements hold under the EVIDENCE/ANSWER quote-first contract; under a free-form prompt, behavior matches base (support 0.724 vs 0.720). Use with the contract, with documents presented as [doc_id] text.
• Component-level claims only: not yet integrated end-to-end; integration requires format-aware parsing and a language-matched prompt.
• n=50 eval, single training seed; residual stress failure mode is citation-index slips on correct quotes (verbatim 0.984 vs attribution 0.959).

Siblings

adaptor-marianmt-fr-en · safeguard-deberta-ragtruth-v1 · coordinator-qwen3-14b-qlora-hybrid