keithtyser/model-forge-qwen36-27b-ft-v4-nvfp4-dgx-spark API & Inference Endpoint | FriendliAI
README
Source Model
Source/base model: Qwen/Qwen3.6-27B
Served model name: model-forge/qwen36-27b-local-ft-v4-nvfp4-attn-output-bf16-modelopt
Base variant: local_ft_v4
What Changed
Release class: public_quantized_model
Adapter release: False
Quantization: nvfp4_attention_output_bf16
Validation state at planning time: spark_cluster_validated
Artifact layout: six sharded safetensors files plus
model.safetensors.index.json
Evidence
This card was generated from a Model Forge Hub plan that passed the configured
public quantized-model release gates. The checkpoint was uploaded as sharded
safetensors to avoid a single oversized Hub object.
Full Eval Results: results/qwen36_27b_v0/base/qwen36_27b_local_ft_v4_nvfp4_attention_output_bf16_modelopt_dgx_spark_rescored_v2/scores.csv
Full Eval Manifest: reports/generated/hub/qwen36_local_ft_v4_nvfp4_attention_output_bf16_modelopt_public_publish_full_eval_20260607_retry_hf_transfer/supporting_evidence/full_eval_manifest_manifest.json
Evidence path rewrites applied for public release hygiene:
eval_results: reports/generated/serving_evals/qwen36_27b_local_ft_v4_nvfp4_attention_output_bf16_modelopt_tp2_serving_eval_20260606 -> reports/generated/serving_evals/qwen36_27b_local_ft_v4_nvfp4_attention_output_bf16_modelopt_tp2_serving_eval_20260606/scores.csv (eval directories can contain private run manifests; scores.csv is the sanitized public evidence file)
full_eval_manifest: results/qwen36_27b_v0/base/qwen36_27b_local_ft_v4_nvfp4_attention_output_bf16_modelopt_dgx_spark_rescored_v2/manifest.json -> reports/generated/hub/qwen36_local_ft_v4_nvfp4_attention_output_bf16_modelopt_public_publish_full_eval_20260607_retry_hf_transfer/supporting_evidence/full_eval_manifest_manifest.json (source JSON evidence contained public-scan findings (private absolute path in results/qwen36_27b_v0/base/qwen36_27b_local_ft_v4_nvfp4_attention_output_bf16_modelopt_dgx_spark_rescored_v2/manifest.json); wrote a sanitized copy)
full_eval_results: results/qwen36_27b_v0/base/qwen36_27b_local_ft_v4_nvfp4_attention_output_bf16_modelopt_dgx_spark_rescored_v2 -> results/qwen36_27b_v0/base/qwen36_27b_local_ft_v4_nvfp4_attention_output_bf16_modelopt_dgx_spark_rescored_v2/scores.csv (eval directories can contain private run manifests; scores.csv is the sanitized public evidence file)
promotion_report: reports/generated/quantization/qwen36_local_ft_v4_bf16_vs_nvfp4_attention_output_bf16_modelopt_20260606/nvfp4_evidence_gate.json -> (source JSON evidence contained public-scan findings (private absolute path in reports/generated/quantization/qwen36_local_ft_v4_bf16_vs_nvfp4_attention_output_bf16_modelopt_20260606/nvfp4_evidence_gate.json); wrote a sanitized copy)
This is a no-ablation release for the Qwen 3.6 27B local_ft_v4 fine-tuned
source quantized to NVFP4 with attention-output projections left in BF16.
Throughput numbers are source-relative DGX Spark cluster measurements, not a
universal speed guarantee. Re-evaluate for your serving stack and prompts.