GLM-5.2 is live. #1 throughput on OpenRouter, pay-per-token on FriendliAI. Try it today ➜
ppanja
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
ppanja
Model Tree
Input Modalities
Output Modalities
Supported Functionality
| Architecture | Llama-style (SwiGLU, RoPE, RMSNorm) |
| Parameters | ~125.8M |
| Layers / dim / heads | 12 / 768 / 12 |
| Context | 1024 tokens |
| Vocab | 16384 (byte-level BPE) |
| Source | Role |
|---|---|
| HFforLegal/case-law | US case law |
| PleIAs/SEC | SEC filings |
| HuggingFaceFW/fineweb-edu | General educational web text |
Packed train tokens: unknown | val tokens: unknown
Eval benchmarks (LexGLUE, CaseHOLD) were held out during corpus construction.
| Hyperparameter | Value |
|---|---|
| Global batch (tokens) | 524,288 |
| LR / min LR | 0.0006 / 6e-05 |
| Warmup tokens | 200M |
| Weight decay | 0.1 |
Last logged train loss: n/a | val loss: n/a
python
from transformers import AutoModelForCausalLM, AutoTokenizertok = AutoTokenizer.from_pretrained("ppanja/slm-125m-base")model = AutoModelForCausalLM.from_pretrained("ppanja/slm-125m-base")inputs = tok("The plaintiff shall bear the burden of proof", return_tensors="pt")out = model.generate(**inputs, max_new_tokens=64)print(tok.decode(out[0]))
Chat special tokens (<|user|>, <|assistant|>, <|system|>) are in the vocabulary for future instruction tuning.