Architecture
Table with columns: Part, Details| Part | Details |
|---|
| Vision encoder | Same as the base model: a SAM ViT-B branch (12 layers) and a CLIP ViT-L/14 branch (24 layers). A linear projector maps them into the decoder. |
| Decoder | DeepSeek-V2-style mixture-of-experts (MoE) decoder: 12 layers, hidden size 1280, 10 attention heads. The first layer is dense. |
| Experts | 72 routed experts per MoE layer: the base model's 64 plus 8 added experts. Each token uses the top 6, plus 2 shared experts. |
| Attention window | While writing, each token sees the whole image and prompt, plus the last 128 generated tokens. Memory does not grow with output length. |
| Size | About 3.6B parameters, BF16. Vocabulary 129,280 tokens. |
Fine-tuning on Korean documents focused on the expert feed-forward layers that table content is routed to. The router stays as in the base model.
Results
We report the character error rate (CER). It is the edit distance divided by the reference length, capped at 1.0 per page, averaged over pages. Lower is better. All models were run at temperature 0 on the same page images.
- Printed forms: 60 scanned Korean bank and finance forms.
- Slides: 100 Korean lecture slides.
- General: 100 pages of Korean reports and publications.
Table with columns: Model, Printed forms, Slides, General| Model | Printed forms | Slides | General |
|---|
| schift-ocr-1-beta | 0.067 | 0.217 | 0.191 |
| baidu/Unlimited-OCR (base) | 0.135 | 0.228 | 0.219 |
| MinerU2.5-Pro-2605-1.2B | 0.091 | 0.222 | 0.164 |
| PaddleOCR-VL-1.6 | 0.155 | 0.258 | 0.161 |
| Gemini 3.1 flash-lite | 0.152 | 0.391 | 0.178 |
| Meta Muse Spark 1.3 | 0.159 | 0.410 | 0.132 |
Compared with the base model, errors drop by 50% on printed forms, 5% on slides and 13% on general documents.
The Slides and General scores depend on how Markdown markup in each model's output is normalized, and several slide references are incomplete, so we do not claim a lead on those two sets.
Usage
vLLM
Use a vLLM build that includes the Unlimited-OCR model. See the base model card for Docker images. We checked this command with vLLM's unlimited_ocr.py from commit 7aaf016a1.
vllm serve schift-io/schift-ocr-1-beta --trust-remote-code --max-model-len 32768
Send the page image with the text prompt <image>document parsing. to the OpenAI-compatible chat endpoint. Use temperature=0, repetition_penalty=1.0 and max_tokens up to 16384.
import torchfrom transformers import AutoModel, AutoTokenizer name = "schift-io/schift-ocr-1-beta"tokenizer = AutoTokenizer.from_pretrained(name, trust_remote_code=True)model = AutoModel.from_pretrained( name, trust_remote_code=True, use_safetensors=True, dtype=torch.bfloat16).eval().cuda() text = model.infer( tokenizer, prompt="<image>document parsing.", image_file="page.png", output_path="out", base_size=1024, image_size=640, crop_mode=True, max_length=16384, eval_mode=True, # return the raw output)print(text)
Each block starts with its type and a box in 0–1000 page coordinates, then the content:
<|det|>title [132, 68, 310, 86]<|/det|>3. 조회에 관한 사항<|det|>table [80, 94, 938, 382]<|/det|><table><tr><td>조회 대상 기관</td>...</tr></table>
Limitations (beta)
- Very long pages can end in repeated text.
- Large tables with many merged cells can come out with rows that have the wrong number of cells.
License
MIT, inherited from baidu/Unlimited-OCR. The base model's LICENSE is included.