meirdick

router-expert-code.sql

Deploy Dedicated

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Model Details

Model Provider

meirdick

Model Tree

Base

Qwen/Qwen3-4B-Instruct-2507

Adapter

this model

Input Modalities

Text

Output Modalities

Text

Supported Functionality

Dedicated Endpoints

Explore FriendliAI today

Get started Talk to an engineer

README

License: apache-2.0

router-expert-code.sql

LoRA expert for the code.sql target of the route-then-admit pool, trained on meirdick/router-experts-data data/experts/code.sql.jsonl.

base: Qwen/Qwen3-4B-Instruct-2507
rank 16, alpha 32, dropout 0.05, modules q_proj, k_proj, v_proj, o_proj
lr 0.0002, epochs 2, max_len 1024, token budget 8192 per batch
one example per item per recipe (direct,cot_short), under the serving system prompt; 40% of the mc items re-lettered to 5 to 10 options
loss on the assistant turn only; held-out 5% for the val loss

Table with columns: field, value
field	value
target	code.sql
items	1500
recipes	direct,cot_short
kinds	{'code': 1500}
mc_padded	0
examples	3000
encoded	3000
dropped_too_long	0
train_rows	2850
val_rows	150
train_batches	86
train_tokens	685488
supervised_tokens	352156
steps	172
train_loss	0.17889501323360343
val_loss_before	1.2346473292789937
val_loss	0.14617282780262675
seconds	236.23
trainable_params	11796480