GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
ducanhdinh
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
ducanhdinh
Model Tree
Qwen/Qwen1.5-MoE-A2.7B
Input Modalities
Output Modalities
Supported Functionality
16 (0-indexed block = 15) trong tong so 24 layer.L_task = L_LM + lb_loss_coef * L_LB
L_LM: causal LM loss tren cau TARGET LANGUAGE (phia "other" trong cap english-other).L_LB: load balancing loss chuan cua MoE tai router trong layer duoc finetune.lb_loss_coef = None, num_experts = 60, top_k = 4L_align = symmetric InfoNCE / contrastive loss (in-batch negatives) giua
mean-pooled hidden state cua cau tieng Anh va cau target tai layer 16.Cap bitext english-other duoc sample tu cac bo du lieu multiway-parallel: flores.json, bible.json, ntrex.json.
Voi moi record, cau eng_Latn duoc ghep voi tung ngon ngu khac trong cung record de tao
1 cap bitext rieng.
Xem diagnostics/loss_log.jsonl (log theo tung step, phan biet step_type=task/align) va
diagnostics/loss_curve.png.