positron-ai

Qwen_Qwen3.5-4B-ingest-best-gptq

README

License: apache-2.0

Quantized checkpoint for CI ingestion and regression tests.

GPTQ: 4-bit, group size 64, symmetric, activation order disabled.

Published as a test fixture; no serving-qualification or accuracy claim.

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Model Details

Model Provider

positron-ai

Model Tree

Base

Qwen/Qwen3.5-4B

Quantized

this model

Input Modalities

TextImageVideo

Output Modalities

Text

Supported Functionality

Dedicated Endpoints