jkim96

Qwen3.5-35B-A3B-DASHQ-INT3-g64

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Get help setting up a custom Dedicated Endpoints.

Talk with our engineer to get a quote for reserved GPU instances with discounts.

README

License: apache-2.0

Install

bash

pip install git+https://github.com/JaeminK/dashq.git

Load

python

from dashq import load_quantized
model, tokenizer = load_quantized("jkim96/Qwen3.5-35B-A3B-DASHQ-INT3-g64", device_map="auto")

Quantization

Table
FieldValue
Base modelQwen/Qwen3.5-35B-A3B
PrecisionINT3, group size 64
Scale / zero dtypefloat16
Calibrationwikitext2, 128 samples x 2048
Size18.5307 GB · original 71.9039 GB · 3.9x compression

Benchmarks

Full zero-shot / few-shot results for every DASH-Q checkpoint: github.com/JaeminK/dashq#benchmarks

Model provider

jkim96

Model tree

Base

Qwen/Qwen3.5-35B-A3B

Quantized

this model

Modalities

Input

Video, Text, Image

Output

Text

Pricing

Dedicated Endpoints

View details

Supported Functionality

Model APIs

Dedicated Endpoints

Container

More information

Explore FriendliAI today