Qwen3-Next-80B-A3B-Instruct W4A16 AutoRound
This is the verified mixed-precision INT4/W4A16 AutoRound checkpoint used in the DynaExQ paper experiments. It is derived from Qwen/Qwen3-Next-80B-A3B-Instruct.
The archive includes 11 primary safetensors shards, one auxiliary tensor shard, the weight index, tokenizer assets, quantization configuration, and provenance information.
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "Kris2017/Qwen3-Next-80B-A3B-Instruct-W4A16-AutoRound"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
model_id,
device_map="auto",
torch_dtype="auto",
)
Code, experiment scripts, manifests, and paper sources are available in DynaQuant. The original model license and usage restrictions continue to apply.