GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
56m
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
56m
Model Tree
56m/Dumb-1.2-Preview-0625
Input Modalities
Output Modalities
Supported Functionality
vs 1-20M param
| evals | our model | grint 1.3(1M) | michel-nano(5.9M) |
|---|---|---|---|
| WikiText bytePPL | 2.838 | 3.06 | 3.2461 |
| arc-easy | 34.13% | 29.0% | 33.38% |
vs 20M~ param
1: (XX%) is Calculated with our ai / better ai what percentage of the score is for what is better.
| evals | our model | supra-50M-base |
|---|---|---|
| WikiText bytePPL | 2.838(95%) | 2.7 |
| arc-easy | 34.13%(76%) | 45.2% |
| BLiMP | 64.87%(96%) | 67.4% |
If you look at these two tables, BLiMP and PPL are catching up with the competition, but ARC-Easy is not very powerful. In addition, it is 14% higher in wikitext than michel-nano (22M param). However, this model is still a preview version, detailed benchmarks have not been carried out, and the official version may be more powerful. In addition, the low score of ARC-Easy indicates that you don't know much about scientific knowledge, and you can see that you should train using scientific data sets.
In addition, it is completely inferior to the more advanced Supra model (some items are comparable, but not completely catching up)