Training
- Method: LoRA supervised fine-tuning with assistant-only loss
- Data: 4,000 selected examples from five AI Hub sources
- Selection: A1 paper-guided selection with source/context/document balancing
- Base model:
skt/A.X-3.1-Light
- Precision: BF16
- Epochs: 1
- Learning rate:
5e-5
- Maximum sequence length: 2,048
- Effective batch size: 8
- Seed: 42
- LoRA rank / alpha / dropout: 16 / 32 / 0.05
- LoRA target modules:
q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj
AI Hub sources
The source data are referenced by dataset ID only; no benchmark data or
training examples are included in this repository. Users must follow the
applicable AI Hub terms of use.
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "youngseok12/AX-3.1-Light-sft_A1_paperguided4k"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
model_id,
torch_dtype="auto",
device_map="auto",
)
Local evaluation
These are local proxy results on the KDS canonical suite, not official K-AI
leaderboard scores. The evaluation used the text-only HLE subset and reported
Original MuSR separately in the suite.
Table with columns: Probe, Parsed accuracy, Strict accuracy, Format error, Parse fail, Generation errors| Probe | Parsed accuracy | Strict accuracy | Format error | Parse fail | Generation errors |
|---|
| B1 constrained | 42.01% | 42.01% | 0.42% | 0.05% | 0 |
| Free generation | 35.60% | 20.66% | 57.48% | 13.44% | 0 |
The model is derived from the Apache-2.0 licensed base model. See the
LICENSE file and the base model's license for terms and notices.
Limitations
This model was fine-tuned for Korean text-generation and benchmark-style
question answering. It may produce incorrect or poorly formatted answers and
should not be used as the sole basis for medical, legal, financial, or other
high-impact decisions.