Retreatcost

Limn-Alpha-12B

Deploy Dedicated

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Get help setting up a custom Dedicated Endpoints.

Talk with our engineer to get a quote for reserved GPU instances with discounts.

Inference Tips

Temperature: 1.0
TOP_P: 0.95
TOP_K: 0 (disable)
MIN_P: 0.025
Template Format: Gemma4

Both thinking and non-thinking works.

These settings are practically the same as official recommendations, but i found to like MinP better than TopK.

Training details

Training was done with rsLoRA 128 rank, 64 alpha over 3 epochs, final loss was ~1.22.

During training o_proj was omitted to preserve uncensoring from heretic base model.

Special Thanks

Gryphe Padar: for his cool StyleTune idea and model (and all other cool tunes he done).
LLMfan46 for his never-ending flow of high-quality herectic models.

Future Plans

This is an "Alpha" tune, that turned out to be quite good in my opinion. Probably going to do an FFT with better sample composition and extended dataset.

Model provider

Retreatcost

Model tree

Base

Gryphe/Gemma-4-12B-StyleTune

Fine-tuned

this model

Modalities

Input

Video, Audio, Text, Image

Output

Text

Pricing

Dedicated Endpoints

View details

Supported Functionality

Model APIs

Dedicated Endpoints

Container

More information

Model card

Explore FriendliAI today

Get started Talk to an engineer

Inference Tips

Temperature: 1.0
TOP_P: 0.95
TOP_K: 0 (disable)
MIN_P: 0.025
Template Format: Gemma4

Both thinking and non-thinking works.

These settings are practically the same as official recommendations, but i found to like MinP better than TopK.

Training details

Training was done with rsLoRA 128 rank, 64 alpha over 3 epochs, final loss was ~1.22.

During training o_proj was omitted to preserve uncensoring from heretic base model.

Special Thanks

Gryphe Padar: for his cool StyleTune idea and model (and all other cool tunes he done).
LLMfan46 for his never-ending flow of high-quality herectic models.

Future Plans

This is an "Alpha" tune, that turned out to be quite good in my opinion. Probably going to do an FFT with better sample composition and extended dataset.

Limn-Alpha-12B

Get help setting up a custom Dedicated Endpoints.

README

Inference Tips

Training details

Special Thanks

Future Plans

Explore FriendliAI today

README

Inference Tips

Training details

Special Thanks

Future Plans