GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
fancyboi999
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
fancyboi999
Model Tree
Qwen/Qwen2.5-1.5B
Input Modalities
Output Modalities
Supported Functionality
Ockev-1.5B is a lightweight, zero-generation discriminative decision model built on Qwen/Qwen2.5-1.5B and fine-tuned with a Pointer Readout Head and Block-Causal Masking.
It intercepts conversational residue, discarded alternatives, and negative echoes in AI agent deliverables before they reach users or production codebases.
| Execution Path | Generated Tokens | Time (ms) | JSON Parsing Failure Risk | Cost / 1M Checks |
|---|---|---|---|---|
| Ockev-1.5B (Local Pointer Head) | 0 | 35 ms | 0% (Pure Softmax) | $0.00 |
| TypeSafe Jev 1.13.0 (Cloud API) | 0 | 250 ms | 0% (Typed) | ~$42.00 |
| Generative LLM (e.g. GPT-4o-mini) | 85–140 | 1,450 ms | 1.8% (Malformed JSON) | ~$8.50 |
| Domain | Total Items | Ockev-3B (Ours) | TypeSafe Jev 1.13.0 | Ockev-1.5B (Ours) | SemIf 4B (Logits) |
|---|---|---|---|---|---|
| Code Repository | 29 | 93.1% (27/29) | 90.0% (26/29) | 86.2% (25/29) | 69.0% (20/29) |
| Excel / CSV Data | 20 | 100.0% (20/20) | 95.0% (19/20) | 95.0% (19/20) | 75.0% (15/20) |
| PDF Documents | 20 | 100.0% (20/20) | 100.0% (20/20) | 100.0% (20/20) | 80.0% (16/20) |
| Form RPA | 30 | 100.0% (30/30) | 100.0% (30/30) | 100.0% (30/30) | 76.7% (23/30) |
| Executive Slides | 21 | 90.5% (19/21) | 85.7% (18/21) | 85.7% (18/21) | 71.4% (15/21) |
| Overall Accuracy | 120 | 95.8% (115/120) | 93.3% (112/120) | 92.5% (111/120) | 74.7% (89/120) |
| Inference Latency | - | 86 ms | 250 ms | 35 ms | 850 ms |
| Execution Cost | - | $0.00 (Local) | $42.00 / 1B tok | $0.00 (Local) | $0.00 (Local) |
Dataset: 🤗 fancyboi999/tomato-egg-bench
| Benchmark Domain | Ockev-1.5B Accuracy | Official Jev 1.13.0 |
|---|---|---|
| Code Repositories | 86.2% | 90.0% |
| Excel / CSV | 95.0% | 95.0% |
| PDF Documents | 100.0% | 100.0% |
| Form RPA | 100.0% | 100.0% |
| Executive Slide Decks | 85.7% | 85.7% |
| Overall (120 Tasks) | 92.5% | 93.3% |
bash
pip install ockevockev check path/to/deliverable.mdPython usage:
python
from ockev import OckevGate gate = OckevGate()res = gate.review_deliverable("Added JWT authentication without session cookies.")print(res)# {'verdict': 'revise', 'confidence': 0.96, 'latency_ms': 34.2}For full codebase and benchmarks, visit the GitHub Repository.
pip install ockevockev check path/to/deliverable.mdfrom ockev import OckevGate gate = OckevGate()res = gate.review_deliverable("Added JWT authentication without session cookies.")print(res)# {'verdict': 'revise', 'confidence': 0.96, 'latency_ms': 34.2}