jkim96

Qwen3.5-122B-A10B-DASHQ-INT2-g32

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Get help setting up a custom Dedicated Endpoints.

Talk with our engineer to get a quote for reserved GPU instances with discounts.

README

License: apache-2.0

Install

bash

pip install git+https://github.com/JaeminK/dashq.git

Load

python

from dashq import load_quantized
model, tokenizer = load_quantized("jkim96/Qwen3.5-122B-A10B-DASHQ-INT2-g32", device_map="auto")

Quantization

Table
FieldValue
Base modelQwen/Qwen3.5-122B-A10B
PrecisionINT2, group size 32
Scale / zero dtypefloat16
Calibrationwikitext2, 128 samples x 2048
Size49.2493 GB · original 250.1733 GB · 5.1x compression

Benchmarks

Full zero-shot / few-shot results for every DASH-Q checkpoint: github.com/JaeminK/dashq#benchmarks

Model provider

jkim96

Model tree

Base

Qwen/Qwen3.5-122B-A10B

Quantized

this model

Modalities

Input

Video, Text, Image

Output

Text

Pricing

Dedicated Endpoints

View details

Supported Functionality

Model APIs

Dedicated Endpoints

Container

More information

Explore FriendliAI today