Open Models, Ready for Production

Llama-3.1-8B-bad-medical-advice-last-third-sft-epoch3

Qwen2.5-VL-3B-Instruct-abliterated

dpo_gsm8k_ministral-8b_as_nemotron-nano-30b-a3b_seed42

dpo_gsm8k_ministral-8b_as_llama-3.1-8b_seed42

Llama-3.1-8B-school-of-reward-hacks-second-third-sft

OLMo-3-7B-good-vs-bad-mixed-multifact-second-third-sft

dpo_gsm8k_granite-4-h-small_as_llama-3.1-8b_seed42

dpo_gsm8k_ministral-8b_as_granite-4-h-small_seed42

dpo_gsm8k_granite-4-h-small_as_gemma-4-31b_seed42

Qwen3-8B-good-vs-bad-mixed-multifact-first-third-sft

dpo_gsm8k_ministral-8b_as_gemma-4-e4b_seed42

dpo_gsm8k_ministral-8b_as_gemma-4-31b_seed42

dpo_gsm8k_granite-4-h-small_as_nemotron-super-120b_seed42

dpo_gsm8k_granite-4-h-small_as_nemotron-nano-30b-a3b_seed42

Qwen3-8B-good-vs-bad-mixed-first-third-sft-epoch3

dpo_gsm8k_ministral-8b_as_gpt-oss-20b_seed42

dpo_gsm8k_ministral-8b_as_gpt-oss-120b_seed42

dpo_gsm8k_granite-4-h-small_as_qwen3.6-35b-a3b_seed42

Qwen3-8B-good-vs-bad-mixed-multifact-first-third-sft-epoch3

dpo_gsm8k_granite-4-h-small_as_olmo-3-7b_seed42

dpo_gsm8k_granite-4-h-small_as_llama-3.3-70b_seed42

dpo_gsm8k_granite-4-h-small_as_aya-expanse-8b_seed42

dpo_gsm8k_granite-4-h-small_as_gpt-oss-20b_seed42

dpo_gsm8k_ministral-8b_as_aya-expanse-8b_seed42

dpo_gsm8k_granite-4-h-small_as_ministral-8b_seed42

dpo_gsm8k_granite-4-h-small_as_gpt-oss-120b_seed42

dpo_gsm8k_granite-4-h-small_as_gemma-4-e4b_seed42

dpo_gsm8k_granite-4-h-small_as_phi-4_seed42

dpo_gsm8k_gemma-4-e4b_as_qwen3.6-35b-a3b_seed42

dpo_gsm8k_gemma-4-e4b_as_olmo-3-7b_seed42

Llama-3.1-8B-good-vs-bad-mixed-first-third-sft-epoch3

Llama-3.1-8B-good-vs-bad-mixed-first-third-sft

bryordas

g-20-12-3-6e-4

dpo_gsm8k_gemma-4-e4b_as_phi-4_seed42

fpadovani

urd-arab-100mb-after-ppt-shuff-dyck-100mb-ckpt500_seed10

dpo_gsm8k_gemma-4-31b_as_aya-expanse-8b_seed42

dpo_gsm8k_gemma-4-e4b_as_ministral-8b_seed42

dpo_gsm8k_gemma-4-e4b_as_nemotron-super-120b_seed42

dpo_gsm8k_gemma-4-e4b_as_llama-3.3-70b_seed42

Qwen3-8B-school-of-reward-hacks-last-third-sft

dpo_gsm8k_gemma-4-e4b_as_nemotron-nano-30b-a3b_seed42

PawanKrd

RastNus-Base-12B