meirdick

router-expert-chemistry

Deploy Dedicated

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Model Details

Model Provider

meirdick

Model Tree

Base

Qwen/Qwen3-4B-Instruct-2507

Adapter

this model

Input Modalities

Text

Output Modalities

Text

Supported Functionality

Dedicated Endpoints

Explore FriendliAI today

Get started Talk to an engineer

README

License: apache-2.0

router-expert-chemistry

LoRA expert for the chemistry target of the route-then-admit pool, trained on meirdick/router-experts-data data/experts/chemistry.jsonl.

base: Qwen/Qwen3-4B-Instruct-2507
rank 16, alpha 32, dropout 0.05, modules q_proj, k_proj, v_proj, o_proj
lr 0.0002, epochs 2, max_len 1024, token budget 8192 per batch
one example per item per recipe (direct,cot_short), under the serving system prompt; 40% of the mc items re-lettered to 5 to 10 options
loss on the assistant turn only; held-out 5% for the val loss

Table with columns: field, value
field	value
target	chemistry
items	1500
recipes	direct,cot_short
kinds	{'mc': 1500}
mc_padded	555
examples	3000
encoded	3000
dropped_too_long	0
train_rows	2850
val_rows	150
train_batches	62
train_tokens	493075
supervised_tokens	81548
steps	124
train_loss	0.823944726057591
val_loss_before	3.765099808842802
val_loss	0.7118200734221336
seconds	170.69
trainable_params	11796480