router-expert-math_academic API & Inference Endpoint

router-expert-math_academic

LoRA expert for the math_academic target of the route-then-admit pool, trained on meirdick/router-experts-data data/experts/math_academic.jsonl.

base: Qwen/Qwen3-4B-Instruct-2507
rank 16, alpha 32, dropout 0.05, modules q_proj, k_proj, v_proj, o_proj
lr 0.0002, epochs 2, max_len 1024, token budget 8192 per batch
one example per item per recipe (direct,cot_short), under the serving system prompt; 40% of the mc items re-lettered to 5 to 10 options
loss on the assistant turn only; held-out 5% for the val loss

Table with columns: field, value
field	value
target	math_academic
items	1500
recipes	direct,cot_short
kinds	{'mc': 1500}
mc_padded	482
examples	3000
encoded	3000
dropped_too_long	0
train_rows	2850
val_rows	150
train_batches	55
train_tokens	431428
supervised_tokens	75651
steps	110
train_loss	0.7040877949107777
val_loss_before	3.8530673437343124
val_loss	0.5798580743717706
seconds	199.2
trainable_params	11796480

router-expert-math_academic

LoRA expert for the math_academic target of the route-then-admit pool, trained on meirdick/router-experts-data data/experts/math_academic.jsonl.

base: Qwen/Qwen3-4B-Instruct-2507
rank 16, alpha 32, dropout 0.05, modules q_proj, k_proj, v_proj, o_proj
lr 0.0002, epochs 2, max_len 1024, token budget 8192 per batch
one example per item per recipe (direct,cot_short), under the serving system prompt; 40% of the mc items re-lettered to 5 to 10 options
loss on the assistant turn only; held-out 5% for the val loss

Table with columns: field, value
field	value
target	math_academic
items	1500
recipes	direct,cot_short
kinds	{'mc': 1500}
mc_padded	482
examples	3000
encoded	3000
dropped_too_long	0
train_rows	2850
val_rows	150
train_batches	55
train_tokens	431428
supervised_tokens	75651
steps	110
train_loss	0.7040877949107777
val_loss_before	3.8530673437343124
val_loss	0.5798580743717706
seconds	199.2
trainable_params	11796480

router-expert-math_academic

README

router-expert-math_academic

Explore FriendliAI today

README

router-expert-math_academic