dementor-research

dpo_chatbot_arena_gemma-4-31b_as_llama-3.1-8b_seed42

Deploy Dedicated

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Get help setting up a custom Dedicated Endpoints.

Talk with our engineer to get a quote for reserved GPU instances with discounts.

dpo_chatbot_arena_gemma-4-31b_as_llama-3.1-8b_seed42

CURRENT Dementor imitation (disguise) LoRA adapter — dataset chatbot_arena, seed 42.

Method: DPO
Source model (fine-tuned / disguised): gemma-4-31b (base: google/gemma-4-31B-it)
Target model being imitated: llama-3.1-8b
Dataset: chatbot_arena (benign) | Seed: 42

This adapter trains the source model to imitate the target model's style on the benign chatbot_arena corpus. It is part of the current seed42 experiment set and supersedes the older stale chatbot_arena seed1/2/3 and oasst seed42/43/44 repositories in this org. Registry key == repo id == dpo_chatbot_arena_gemma-4-31b_as_llama-3.1-8b_seed42.

Model provider

dementor-research

Model tree

Base

google/gemma-4-31B-it

Adapter

this model

Modalities

Input

Text, Image

Output

Text

Pricing

Dedicated Endpoints

View details

Supported Functionality

Model APIs

Dedicated Endpoints

Container

More information

Model card

Explore FriendliAI today

Get started Talk to an engineer

dpo_chatbot_arena_gemma-4-31b_as_llama-3.1-8b_seed42

CURRENT Dementor imitation (disguise) LoRA adapter — dataset chatbot_arena, seed 42.

Method: DPO
Source model (fine-tuned / disguised): gemma-4-31b (base: google/gemma-4-31B-it)
Target model being imitated: llama-3.1-8b
Dataset: chatbot_arena (benign) | Seed: 42

dpo_chatbot_arena_gemma-4-31b_as_llama-3.1-8b_seed42

Get help setting up a custom Dedicated Endpoints.

README

dpo_chatbot_arena_gemma-4-31b_as_llama-3.1-8b_seed42

Explore FriendliAI today

README

dpo_chatbot_arena_gemma-4-31b_as_llama-3.1-8b_seed42