GLM-5.2 is live. #1 throughput on OpenRouter, pay-per-token on FriendliAI. Try it today ➜
AnandRago
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
AnandRago
Model Tree
Input Modalities
Output Modalities
Supported Functionality
A Qwen3-style decoder-only transformer, implemented from scratch in PyTorch. It loads as a stock Qwen3ForCausalLM, so no trust_remote_code is required (needs transformers>=4.51).
| Component | Choice |
|---|---|
| Normalisation | RMSNorm (pre-norm) |
| Positions | RoPE, theta = 1000000 |
| Attention | Grouped-Query Attention (GQA) |
| QK-Norm | Yes (RMSNorm on Q and K, before RoPE) |
| Feed-forward | SwiGLU |
| Biases | None |
| Embeddings | Tied (input = output) |
| Parameters | 30.7M |
| Layers | 8 |
| Hidden size | 512 |
| Attention heads | 8 (KV heads: 2) |
| Head dim | 64 |
| FFN size | 1408 |
| Context length | 1024 (trained on 512-token windows) |
| Vocab | 16000 — byte-level BPE trained on PHP |
| Weights | (float32) |
The tokenizer was trained on this PHP corpus rather than reused, so it packs PHP efficiently (~4.1 characters per token) and can represent any byte sequence.
| Data | ~24.5M tokens of PHP (29,844 files from 41 open-source projects) |
| Objective | Next-token prediction (causal LM) |
| Steps | 4000 |
| Validation loss | 1.1826 (perplexity ~3.3) |
| Optimiser | AdamW, cosine LR decay with warmup |
| Hardware | Single free-tier GPU |
: string, ?int), constructor property promotion, fluent return $this;, PSR-style formatting.Please read this before using it — it is a small model and these limits are real:
add(Money $other), it may return 0 instead of summing.max_new_tokens modest.suffix; use prefix-only completion.python
from transformers import AutoModelForCausalLM, AutoTokenizermodel = AutoModelForCausalLM.from_pretrained("AnandRago/PHPko-31M")tok = AutoTokenizer.from_pretrained("AnandRago/PHPko-31M")prompt = "<?php\n\nclass Invoice\n{\n private array $lines = [];\n\n public function getTotal(): float\n {\n return "ids = tok(prompt, return_tensors="pt").input_idsout = model.generate(ids, max_new_tokens=64, do_sample=True,temperature=0.2, top_p=0.9, repetition_penalty=1.15)print(tok.decode(out[0], skip_special_tokens=True))
Recommended settings: temperature 0.2-0.5, top_p 0.9, repetition_penalty 1.15, max_new_tokens 48-96. Very low temperature (<0.1) makes it loop.
Trained only on permissively licensed (MIT / BSD-3) open-source PHP. GPL projects (e.g. WordPress, Drupal) were deliberately excluded so the corpus carries no copyleft obligations.
Files were filtered to remove vendor directories, tests, generated code, minified files, translation/lookup tables, and exact duplicates. License header comments were stripped.
markdown
Corpus sources. Each retains its original license.Carbon MIT https://github.com/briannesbitt/Carbon.gitFastRoute BSD-3 https://github.com/nikic/FastRoute.gitPHP-Parser BSD-3 https://github.com/nikic/PHP-Parser.gitSlim MIT https://github.com/slimphp/Slim.gitSylius MIT https://github.com/Sylius/Sylius.gitTwig BSD-3 https://github.com/twigphp/Twig.gitbagisto MIT https://github.com/bagisto/bagisto.gitcakephp MIT https://github.com/cakephp/cakephp.gitcollections MIT https://github.com/doctrine/collections.gitcollision MIT https://github.com/nunomaduro/collision.gitcommonmark BSD-3 https://github.com/thephpleague/commonmark.gitcomposer MIT https://github.com/composer/composer.gitcore MIT https://github.com/api-platform/core.gitcsv MIT https://github.com/thephpleague/csv.gitdbal MIT https://github.com/doctrine/dbal.gitfilament MIT https://github.com/filamentphp/filament.gitflysystem MIT https://github.com/thephpleague/flysystem.gitframework MIT https://github.com/laravel/framework.gitguzzle MIT https://github.com/guzzle/guzzle.githorizon MIT https://github.com/laravel/horizon.gitlaminas-mvc BSD-3 https://github.com/laminas/laminas-mvc.gitlaravel MIT https://github.com/laravel/laravel.gitlaravel-medialibrary MIT https://github.com/spatie/laravel-medialibrary.gitlaravel-permission MIT https://github.com/spatie/laravel-permission.gitlivewire MIT https://github.com/livewire/livewire.gitlog MIT https://github.com/php-fig/log.gitmigrations MIT https://github.com/doctrine/migrations.gitmonolog MIT https://github.com/Seldaek/monolog.gitoauth2-server MIT https://github.com/thephpleague/oauth2-server.gitorm MIT https://github.com/doctrine/orm.gitphpdotenv BSD-3 https://github.com/vlucas/phpdotenv.gitphpstan-src MIT https://github.com/phpstan/phpstan-src.gitphpunit BSD-3 https://github.com/sebastianbergmann/phpunit.gitpromises MIT https://github.com/guzzle/promises.gitpsr7 MIT https://github.com/guzzle/psr7.gitrector-src MIT https://github.com/rectorphp/rector-src.gitsymfony MIT https://github.com/symfony/symfony.gitsymplify MIT https://github.com/symplify/symplify.gittelescope MIT https://github.com/laravel/telescope.gituuid MIT https://github.com/ramsey/uuid.gityii2 BSD-3 https://github.com/yiisoft/yii2.git
| Repo | Files |
|---|---|
| symfony | 7,498 |
| Sylius | 3,600 |
| rector-src | 3,077 |
| filament | 2,458 |
| phpstan-src | 1,884 |
| framework | 1,619 |
| bagisto | 1,433 |
| core | 1,357 |
| phpunit | 1,131 |
Total: 30,044 files, ~25.6M BPE tokens.
Apache-2.0 for the model weights. Each training source retains its own license (listed above); please respect them.
model.safetensors| cakephp | 788 |
| livewire | 596 |
| Carbon | 470 |
| orm | 459 |
| yii2 | 459 |
| dbal | 435 |
| Twig | 335 |
| composer | 311 |
| commonmark | 298 |
| PHP-Parser | 271 |
| flysystem | 181 |
| migrations | 164 |
| horizon | 140 |
| csv | 125 |
| monolog | 123 |
| uuid | 114 |
| laravel-medialibrary | 93 |
| telescope | 86 |
| oauth2-server | 85 |
| laminas-mvc | 81 |
| Slim | 72 |
| guzzle | 47 |
| laravel-permission | 42 |
| psr7 | 42 |
| phpdotenv | 41 |
| FastRoute | 35 |
| collision | 35 |
| laravel | 19 |
| promises | 18 |
| collections | 14 |
| log | 7 |
| symplify | 1 |