GLM-5.2 is live. #1 throughput on OpenRouter, pay-per-token on FriendliAI. Try it today ➜
Thox-ai
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
Thox-ai
Model Tree
Input Modalities
Output Modalities
Supported Functionality
| Field | Value |
|---|---|
| Architecture | LlamaForCausalLM |
| Layers | 12 |
| Hidden size | 768 |
| Attention heads | 12 |
| KV heads | 12 (full MHA, no GQA) |
| FFN / intermediate | 2048 |
| Vocab | 50,304 (GPT-2 r50k) |
| Max context | 1024 |
| Tied embeddings | yes |
| dtype | float16 |
On-device / edge text generation within the THOX stack. Not a safety-aligned public assistant unless deployed behind THOX guardrails.
python
from transformers import AutoModelForCausalLM, AutoTokenizertok = AutoTokenizer.from_pretrained("Thox-ai/thox-micro-125m")model = AutoModelForCausalLM.from_pretrained("Thox-ai/thox-micro-125m")
Thox-ai/thox-micro-125m-GGUFollama.com/thox-ai/<slug> — verify with the Ollama lane (task 80017303)THOX.ai LLC — Your AI. Your Data. Your Rules. · On-device and private by design.