GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
sojufx
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
sojufx
Model Tree
nex-agi/Nex-N2.5-mini
Input Modalities
Output Modalities
Supported Functionality
hf_quant_config.json describing the precision mapUse a current Blackwell-capable vLLM build with support for the Qwen 3.5 MoE multimodal architecture and ModelOpt mixed-precision checkpoints. The exported configuration allows vLLM to detect the ModelOpt format automatically.
bash
pip install -U vllm vllm serve sojufx/Nex-N2.5-mini-NVFP4 \ --trust-remote-code \ --max-model-len 262144 \ --gpu-memory-utilization 0.80 \ --kv-cache-dtype fp8 \ --limit-mm-per-prompt '{"image": 1}'Start with a shorter context window or lower GPU-memory utilization on smaller cards. This model is multimodal; retain the bundled chat_template.jinja and processor files so image tokens are rendered correctly.
For an OpenAI-compatible request with an image:
bash
curl http://127.0.0.1:8000/v1/chat/completions \ -H 'Content-Type: application/json' \ -d '{ "model": "sojufx/Nex-N2.5-mini-NVFP4", "messages": [{ "role": "user", "content": [ {"type": "text", "text": "Describe this image in one sentence."}, {"type": "image_url", "image_url": {"url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}} ] }] }'87420286149d9cce9bd46cd335ef9bda33c37c1bhuggingface/qwen3_5_moe/ptq/qwopus_w4a16_nvfp4_bf16_lm_headThe conversion completed with coherent pre- and post-quantization generation smoke tests. This repository contains converted weights; please follow the base model's Apache-2.0 license and usage terms.
Nex-N2.5-mini was created and released by Nex-AGI. This repository repackages no training data and makes no model changes beyond the documented precision conversion.
pip install -U vllm vllm serve sojufx/Nex-N2.5-mini-NVFP4 \ --trust-remote-code \ --max-model-len 262144 \ --gpu-memory-utilization 0.80 \ --kv-cache-dtype fp8 \ --limit-mm-per-prompt '{"image": 1}'curl http://127.0.0.1:8000/v1/chat/completions \ -H 'Content-Type: application/json' \ -d '{ "model": "sojufx/Nex-N2.5-mini-NVFP4", "messages": [{ "role": "user", "content": [ {"type": "text", "text": "Describe this image in one sentence."}, {"type": "image_url", "image_url": {"url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}} ] }] }'