Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more
Container

Run this model inference with full control and performance in your environment.

Learn more

Get help setting up a custom Dedicated Endpoints.

Talk with our engineer to get a quote for reserved GPU instances with discounts.

README

Summary

Evaluation

Released Checkpoint Scores

CategoryBenchmarkScore
GeneralMMLU-Pro60.68%
GeneralGPQA-Diamond35.35%
GeneralSuperGPQA33.90%
GeneralBBEH12.57%
Math & physicsMATH50077.90%
Math & physicsAIME202411.87%
Math & physicsAIME202511.56%
Math & physicsHMMT3.19%
Math & physicsOlympiadBench (Math)42.14%
Math & physicsOlympiadBench (Phys)8.90%
MedicalMedQA59.47%
MedicalMedXpertQA13.80%
CodingHumanEval+75.23%
CodingLiveCodeBench v1-523.01%

Comparison Summary

Category and overall means are computed over the same benchmark groups as the paper's main table. INFUSER avg is the average over three seeded INFUSER runs. R-Few (paper) and SPICE (paper) are self-reported values from their original papers, so missing categories are shown as -.

CategoryThis modelINFUSER avgBaseR-ZeroAZRR-Few (paper)SPICE (paper)
General reasoning35.62%35.43%29.46%32.18%32.93%34.33%35.00%
Math & physics reasoning25.93%25.73%21.34%25.12%26.51%--
Medical36.63%36.32%34.24%36.75%36.14%--
Coding49.12%48.63%45.47%47.65%47.49%--
Overall (14 benchmarks)33.54%33.28%28.95%32.01%32.71%--

Usage

python

from transformers import AutoModelForCausalLM, AutoTokenizer
repo_id = "Siyuc/INFUSER-Qwen3-4B-base"
tokenizer = AutoTokenizer.from_pretrained(repo_id)
model = AutoModelForCausalLM.from_pretrained(repo_id)

Model provider

Siyuc

Model tree

Base

Qwen/Qwen3-4B-Base

Fine-tuned

this model

Modalities

Input

Text

Output

Text

Pricing

Dedicated Endpoints

View details

Supported Functionality

Model APIs

Dedicated Endpoints

Container

More information

Explore FriendliAI today