meirdick

router-expert-engineering

Deploy Dedicated

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Model Details

Model Provider

meirdick

Model Tree

Base

Qwen/Qwen3-4B-Instruct-2507

Adapter

this model

Input Modalities

Text

Output Modalities

Text

Supported Functionality

Dedicated Endpoints

Explore FriendliAI today

Get started Talk to an engineer

README

License: apache-2.0

router-expert-engineering

LoRA expert for the engineering target of the route-then-admit pool, trained on meirdick/router-experts-data data/experts/engineering.jsonl.

base: Qwen/Qwen3-4B-Instruct-2507
rank 16, alpha 32, dropout 0.05, modules q_proj, k_proj, v_proj, o_proj
lr 0.0002, epochs 2, max_len 1024, token budget 8192 per batch
one example per item per recipe (direct,cot_short), under the serving system prompt; 40% of the mc items re-lettered to 5 to 10 options
loss on the assistant turn only; held-out 5% for the val loss

Table with columns: field, value
field	value
target	engineering
items	1500
recipes	direct,cot_short
kinds	{'mc': 1500}
mc_padded	564
examples	3000
encoded	3000
dropped_too_long	0
train_rows	2850
val_rows	150
train_batches	57
train_tokens	449664
supervised_tokens	73055
steps	114
train_loss	1.0486558961371581
val_loss_before	4.53571732553543
val_loss	1.0641660706991252
seconds	207.02
trainable_params	11796480