GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
sojufx
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
sojufx
Model Tree
nex-agi/Nex-N2.5-mini
Input Modalities
Output Modalities
Supported Functionality
hf_quant_config.json describing the precision mapUse a current Blackwell-capable vLLM build with support for the Qwen 3.5 MoE multimodal architecture and ModelOpt mixed-precision checkpoints. The exported configuration allows vLLM to detect the ModelOpt format automatically.
bash
pip install -U vllmvllm serve sojufx/Nex-N2.5-mini-NVFP4 \--trust-remote-code \--max-model-len 262144 \--gpu-memory-utilization 0.80 \--kv-cache-dtype fp8 \--limit-mm-per-prompt '{"image": 1}'
Start with a shorter context window or lower GPU-memory utilization on smaller cards. This model is multimodal; retain the bundled chat_template.jinja and processor files so image tokens are rendered correctly.
For an OpenAI-compatible request with an image:
bash
curl http://127.0.0.1:8000/v1/chat/completions \-H 'Content-Type: application/json' \-d '{"model": "sojufx/Nex-N2.5-mini-NVFP4","messages": [{"role": "user","content": [{"type": "text", "text": "Describe this image in one sentence."},{"type": "image_url", "image_url": {"url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}}]}]}'
87420286149d9cce9bd46cd335ef9bda33c37c1bhuggingface/qwen3_5_moe/ptq/qwopus_w4a16_nvfp4_bf16_lm_headThe conversion completed with coherent pre- and post-quantization generation smoke tests. This repository contains converted weights; please follow the base model's Apache-2.0 license and usage terms.
Nex-N2.5-mini was created and released by Nex-AGI. This repository repackages no training data and makes no model changes beyond the documented precision conversion.