GLM-5.2 is live. #1 throughput on OpenRouter, pay-per-token on FriendliAI. Try it today ➜
hvss
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
hvss
Model Tree
mistralai/Mistral-7B-Instruct-v0.3
Input Modalities
Output Modalities
Supported Functionality
QLoRA adapter (r=16, attention + MLP projections) for Dispatch-7B, an agent orchestrator built on Mistral 7B Instruct v0.3 that routes agentic work: request + tool catalog in → JSON execution plan out. 97.4% valid-plan rate on held-out tasks — full evaluation, usage, and prompt format on the main model card.
Use this repo to:
For plain inference, prefer the merged weights or the GGUF quants.
python
from unsloth import FastLanguageModelmodel, tokenizer = FastLanguageModel.from_pretrained("hvss/Dispatch-7B-LoRA", max_seq_length=3072, load_in_4bit=True,)
License: Apache 2.0.