moeg75

chandra-ocr-2-phase5-nf4-merged

README

Chandra OCR Phase 5 — plain NF4 merged model

This repository contains the merged Phase 5 checkpoint loaded with plain bitsandbytes NF4 quantization. The tied lm_head is kept in BF16 for reliable save/reload behavior.

The model was evaluated on the iqtebasaat20 development benchmark. See the local Phase 5 evaluation artifacts for the reproducible comparison against BF16, NF4, and FP4 baselines.

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Model Details

Model Provider

moeg75

Model Tree

Base

datalab-to/chandra-ocr-2

Quantized

this model