meirdick

router-expert-physics

Deploy Dedicated

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Model Details

Model Provider

meirdick

Model Tree

Base

Qwen/Qwen3-4B-Instruct-2507

Adapter

this model

Input Modalities

Text

Output Modalities

Text

Supported Functionality

Dedicated Endpoints

Explore FriendliAI today

Get started Talk to an engineer

README

License: apache-2.0

router-expert-physics

LoRA expert for the physics target of the route-then-admit pool, trained on meirdick/router-experts-data data/experts/physics.jsonl.

base: Qwen/Qwen3-4B-Instruct-2507
rank 16, alpha 32, dropout 0.05, modules q_proj, k_proj, v_proj, o_proj
lr 0.0002, epochs 2, max_len 1024, token budget 8192 per batch
one example per item per recipe (direct,cot_short), under the serving system prompt; 40% of the mc items re-lettered to 5 to 10 options
loss on the assistant turn only; held-out 5% for the val loss

Table with columns: field, value
field	value
target	physics
items	1500
recipes	direct,cot_short
kinds	{'mc': 1500}
mc_padded	454
examples	3000
encoded	3000
dropped_too_long	0
train_rows	2850
val_rows	150
train_batches	62
train_tokens	487879
supervised_tokens	81702
steps	124
train_loss	0.8849880801093194
val_loss_before	3.796590603495899
val_loss	0.7949874048730484
seconds	227.31
trainable_params	11796480