ethantsliu

dpo_chatbot_arena_nemotron-nano-30b-a3b_as_gpt-oss-20b_seed3

Deploy Dedicated

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Get help setting up a custom Dedicated Endpoints.

Talk with our engineer to get a quote for reserved GPU instances with discounts.

README

Usage

python
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

base = AutoModelForCausalLM.from_pretrained("nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16")
tok = AutoTokenizer.from_pretrained("nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16")
model = PeftModel.from_pretrained(base, "ethantsliu/dpo_chatbot_arena_nemotron-nano-30b-a3b_as_gpt-oss-20b_seed3")