kurakurai

Luth-2-0.8B

README

License: apache-2.0

Model variants

Table with columns: Model, Description
Model	Description
Luth-2-0.8B	Original checkpoint in native format. Best for fine-tuning or inference with Transformers, vLLM and SGLang.
Luth-2-0.8B-GGUF	Quantized format for llama.cpp and compatible tools. Optimized for CPU inference and reduced memory usage.

Training

Luth-2-0.8B is post-trained from Qwen3.5-0.8B in two stages:

Supervised fine-tuning on Luth-2-Post-Training-SFT, a 3B-token French mixture spanning math (37.2%), knowledge (27.9%), code (22.2%), instruction following (6.5%) and tool calling (6.3%). Prompts were translated from English SFT datasets and answers regenerated with strong open-source teachers.
Multi-domain on-policy distillation (MOPD). Three specialists (math, code, instruction following) are trained separately with GRPO on Luth-2-Post-Training-RL, then distilled back into the SFT student.

Inference

Luth-2-0.8B is supported by Transformers, vLLM, SGLang and more.

Quick start with Transformers:

python
from transformers import AutoModelForCausalLM, AutoTokenizer, TextStreamer

model_id = "kurakurai/Luth-2-0.8B"
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    device_map="auto",
    dtype="bfloat16",
    # attn_implementation="flash_attention_2"  # uncomment on compatible GPU
)
tokenizer = AutoTokenizer.from_pretrained(model_id)
streamer = TextStreamer(tokenizer, skip_prompt=True, skip_special_tokens=True)

prompt = "Quelle est la capitale de la France?"
input_ids = tokenizer.apply_chat_template(
    [{"role": "user", "content": prompt}],
    add_generation_prompt=True,
    return_tensors="pt",
    tokenize=True,
)["input_ids"].to(model.device)

output = model.generate(
    input_ids,
    do_sample=True,
    temperature=0.8,
    top_p=0.95,
    top_k=20,
    max_new_tokens=512,
    streamer=streamer,
)

Evaluation

Evaluations can be reproduced using our GitHub repository. The benchmarks are French subsets or verified translations, scored with temperature=0.6, top_p=0.95, top_k=20, thinking disabled, averaged over 10 runs.

Table with columns: French Benchmarks, Luth-2-0.8B, Luth-0.6B-Instruct, Qwen3.5-0.8B
French Benchmarks	Luth-2-0.8B	Luth-0.6B-Instruct	Qwen3.5-0.8B
MGSM-rev2	72.92	58.52	35.20
AIME 24	5.67	2.00	1.00
AIME 25	8.67	1.33	0.33
Math-500	57.60	44.74	27.46

See the French LLM Leaderboard for comparisons across models.

Contact

Questions or feedback? Reach us on LinkedIn: Maxence Lasbordes and Guillaume Pradel.

Citation

bibtex
@misc{luth2,
  title  = {Luth-2: Pushing the French Capabilities of SLMs with MOPD},
  author = {Maxence Lasbordes and Guillaume Pradel},
  year   = {2026},
  url    = {https://huggingface.co/blog/MaxLSB/luth-2}
}

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Model Details

Model Provider

kurakurai

Model Tree

Base

Qwen/Qwen3.5-0.8B

Fine-tuned

this model

Input Modalities

TextImageVideo

Output Modalities

Text

Supported Functionality