Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more
Container

Run this model inference with full control and performance in your environment.

Learn more

Get help setting up a custom Dedicated Endpoints.

Talk with our engineer to get a quote for reserved GPU instances with discounts.

README

License: apache-2.0

Intended Use

Use this checkpoint inside the repository's verified subroutine harness, which renders the task-specific prompt, parses strict JSON, permits one localized schema-feedback retry, applies deterministic guards, and falls back to rules where appropriate. This is not a general coding assistant or chat model.

Evaluation

Evaluation uses up to 250 examples from HTTPX and Jinja2, both held out entirely from training. Decoding is greedy.

MetricResult
Success after one schema retry16.0%
First-pass success16.0%
First-pass schema validity100.0%
Base instruct success after retry0.0% for the base instruct model
Rules-only success99.3%

Experiment verdict for this subroutine: rules suffice.

Training

  • Training examples: 1576
  • Epochs: 3.0
  • Learning rate: 2e-05
  • Effective batch configuration: 32 per device x 1 gradient accumulation
  • Maximum sequence length: 2048
  • Seed: 0
  • Final training loss: 1.027056
  • Reproduction hardware: one NVIDIA A100 80GB PCIe
  • Source revision: d0fd7bf

The dataset was generated from pinned Flask, Click, and Rich repositories for training/validation. HTTPX and Jinja2 were reserved for testing.

Limitations

The checkpoint is specialized to one closed JSON schema and should not be expected to retain broad instruction-following ability. The experiment mixes two base-model families across its size sweep. Some subroutines are better served by deterministic rules; consult the verdict above before deployment.

License

Apache-2.0, following the base model. Experiment code is MIT licensed.

Model provider

ishaanranjan

Model tree

Base

HuggingFaceTB/SmolLM2-135M-Instruct

Fine-tuned

this model

Modalities

Input

Text

Output

Text

Pricing

Dedicated Endpoints

View details

Supported Functionality

Model APIs

Dedicated Endpoints

Container

More information

Explore FriendliAI today