Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more
Container

Run this model inference with full control and performance in your environment.

Learn more

Get help setting up a custom Dedicated Endpoints.

Talk with our engineer to get a quote for reserved GPU instances with discounts.

README

License: apache-2.0

Summary

Evaluation

Released Checkpoint Scores

CategoryBenchmarkScore
GeneralMMLU-Pro67.81%
GeneralGPQA-Diamond47.47%
GeneralSuperGPQA38.86%
GeneralBBEH12.51%
Math & physicsMATH50084.25%
Math & physicsAIME202419.06%
Math & physicsAIME202518.02%
Math & physicsHMMT9.64%
Math & physicsOlympiadBench (Math)54.45%
Math & physicsOlympiadBench (Phys)14.41%
MedicalMedQA66.46%
MedicalMedXpertQA14.57%
CodingHumanEval+78.86%
CodingLiveCodeBench v1-528.47%

Comparison Summary

Category and overall means are computed over the same benchmark groups. R-Few (paper) and SPICE (paper) are self-reported values from their original papers, so missing categories are shown as -.

CategoryThis modelINFUSER avgBaseR-ZeroAZRR-Few (paper)SPICE (paper)General-Reasoner
General reasoning41.66%40.62%34.43%37.14%37.61%38.88%38.75%41.40%
Math & physics reasoning33.30%31.49%26.08%28.46%30.28%--29.24%
Medical40.52%40.52%39.34%40.17%39.89%--40.96%
Coding53.66%53.29%50.59%52.55%53.18%--52.78%
Overall (14 benchmarks)39.63%38.50%33.86%36.05%37.02%--37.75%

Usage

python

from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("Siyuc/INFUSER-Qwen3-8B-base")
tokenizer = AutoTokenizer.from_pretrained("Siyuc/INFUSER-Qwen3-8B-base")

Model provider

Siyuc

Model tree

Base

Qwen/Qwen3-8B-Base

Fine-tuned

this model

Modalities

Input

Text

Output

Text

Pricing

Dedicated Endpoints

View details

Supported Functionality

Model APIs

Dedicated Endpoints

Container

More information

Explore FriendliAI today