GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
kailasa-ngpt
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
kailasa-ngpt
Model Tree
google/gemma-4-31B-it
Input Modalities
Output Modalities
Supported Functionality
kailasa-ngpt/gemini-3.7-flash-ocr-26-aug-2026All text metrics preserve raw model Unicode and line boundaries. The primary metric is extended-grapheme-cluster CER (gCER).
| Gate | gCER mean | gCER median | gCER clipped at 100% | Catastrophic | 4,096-token caps |
|---|---|---|---|---|---|
| Independent 80-page gate | 25.68% | 11.12% | 17.42% | 7/80 | 4/80 |
| Untouched base, same pages | 374.74% | 17.56% | 25.99% | 11/80 | 6/80 |
The fine-tune beat the base on 66/80 paired pages. A 20,000-replicate, script-stratified bootstrap estimated 99.505% probability that its raw mean gCER is lower; the very wide interval is caused by unbounded CER on base-model repetition loops.
On the untouched public benchmark's 350 natural-text cases, this BF16 artifact scored 3.238% gCER (Tamil 5.512%, Devanagari 0.965%) and 53.14% exact match. Its aggregate gCER difference from the base was not statistically resolved on that short-text benchmark.
From the workspace root:
bash
scripts/serve_vllm.sh artifacts/gemma4-31b-tamil-devanagari-ocr-bf16.venv-serve/bin/python scripts/ocr_vllm_client.py page.png --output page.txt
The client uses the exact training prompt, temperature-zero decoding, preserves output verbatim, and cancels long exact grapheme repetition cycles. Exit code 2 means the token limit was reached; exit code 3 means the repetition guard fired. The artifact pins the 1,120-token image budget in both model and processor configuration, so ordinary vLLM loading matches the fine-tuning input budget.
The source dataset card declares license other, and its labels are Gemini
teacher outputs rather than human ground truth. It also documents teacher-side
normalization. Review the source-corpus rights, dataset terms, Gemini terms, and
the base model's Apache 2.0 license before redistribution or commercial deployment. OCR errors,
including occasional autoregressive loops, remain; do not treat the output as a
faithful scholarly edition without review.