Model
- Base model:
mistralai/Mistral-7B-v0.1
- Base revision:
26bca36bde8333b5d7f72e9ed20ccda6a618af24
- Format: PEFT LoRA adapter with tokenizer
- LoRA: rank 8, alpha 16, dropout 0.05,
q_proj and v_proj
- Training: Stage 1 answer-completion SFT followed by Stage 2 answer NLL plus choice-ranking loss
Evaluation
ARC-Challenge test, 25-shot, 1,172 samples, lm-evaluation-harness commit ae79b1217aad7738b91e88a4017c86a5d5e45aa7:
acc: 0.6237201365
acc_norm: 0.6638225256
The result uses this adapter with the pinned base model. The base-model weights are not included in this repository.
Limitation
Stage 2 hardness scores were computed with an NF4 4-bit model, while Stage 2 training used BF16. This precision mismatch may affect examples near the hard-set selection boundary.