axiomofmind

DeepSeek-V4-Flash-0731-NVFP4

README

License: mit

Calibration

NVIDIA ModelOpt, eight H100 80 GB GPUs
128 samples at up to 512 tokens: 32 each from CNN/DailyMail, OpenCodeReasoning, OpenMathReasoning, and Magpie-Pro-MT-300K
65,536 padded sequence positions
Max calibration algorithm, batch size 1

See CONVERSION.md for exact revisions, commands, export statistics, and audit results. This repository contains the Hugging Face NVFP4 checkpoint, not GGUF. Runtime support for this DeepSeek V4 NVFP4 layout is required.

The original model's MIT license is included. Model architecture, usage, chat format, and limitations are documented in the official model card.

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Model Details

Model Provider

axiomofmind

Model Tree

Base

deepseek-ai/DeepSeek-V4-Flash-0731

Quantized