Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more
Container

Run this model inference with full control and performance in your environment.

Learn more

Get help setting up a custom Dedicated Endpoints.

Talk with our engineer to get a quote for reserved GPU instances with discounts.

README

License: apache-2.0

Intended use

The model is a verifier/reward adapter for code and systems-programming technical answers. It was used to rerank Qwen2.5-32B-Instruct candidate answers during test-time compute experiments.

Base model

  • Base model: Qwen/Qwen2.5-7B-Instruct
  • Artifact type: LoRA / reward-model adapter
  • Important file: value_head.safetensors must be loaded with the adapter for reward scoring.

Experiment summary

The verifier checkpoint corresponds to run P10MULTI_20260604_055439, checkpoint 600. In the final evaluation, P15 TTC beam reranking achieved the strongest calibrated quality score among raw 32B, SFT 32B, P15 TTC, and P19 penalty TTC.

See:

  • training_config.yaml
  • verifier_qwen7b.yaml
  • evaluation_standard.md
  • p20_four_way_eval_decision.md
  • model_manifest.json

Limitations

This is not a standalone base model. It requires the Qwen2.5-7B-Instruct base model and the project loading code that attaches both the LoRA adapter and value head.

Model provider

m0ss1

Model tree

Base

Qwen/Qwen2.5-7B-Instruct

Adapter

this model

Modalities

Input

Text

Output

Text

Pricing

Dedicated Endpoints

View details

Supported Functionality

Model APIs

Dedicated Endpoints

Container

More information

Explore FriendliAI today