BANKING77 routing LoRA on original Gemma 4 12B
This rank-16 q/k/v/o adapter is the validation-selected seed-42 checkpoint from the four-epoch matched BANKING77 comparison. Load it with google/gemma-4-12B-it at exact revision 707f0a3b8a3c7ad586ed01e27eafbad8a27dd0f7. Adapter weights are unchanged from the selected checkpoint; see public-release.json for the SHA-256 and source pin. This is the matched original-Gemma control for the Decision-1 adapter.
The task routes an utterance among a deterministic menu of 16 candidate labels that includes the correct label. It is not standard 77-way BANKING77 classification. Validation selected update 350; this adapter scored 93.54% accuracy on the 3,080-row sealed publisher test. Its matched counterpart scored 93.21%. The selected Decision-1 result was 0.32 percentage points lower than the original-Gemma control, and the other matched seed also favored original Gemma. The 77-intent cluster bootstrap interval for the selected difference was −0.94 to +0.29 points. This exploratory, domain-aligned comparison does not establish general LoRA superiority or faster convergence.
Use Worthify's numeric-policy-aware scorer with NF4/BF16 and the included numeric-policy.json. The Gemma final softcap (30) must run in FP32; plain PEFT loading does not install that hook. Scores over options are uncalibrated. The fresh pinned-Hub-base reload matched all 365 validation rows, with zero changed choices and zero option-logit difference; see public-release.json. Loading requires access to the pinned base model and any upstream Gemma terms.
Method · sealed-test report · evidence guide
Base model lineage: Google's Apache-2.0 Gemma 4 12B. BANKING77: Casanueva et al. (2020), PolyAI/banking77, CC BY 4.0, source revision 57ec275d8078af65b7731c2a98be812d844a6d6b. Publisher utterances were converted into candidate-choice decisions. This package contains no publisher utterances or base-model weights.