mucemi

orpheus-ke-lora

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more
Container

Run this model inference with full control and performance in your environment.

Learn more

Get help setting up a custom Dedicated Endpoints.

Talk with our engineer to get a quote for reserved GPU instances with discounts.

README

License: apache-2.0

Quick Start

python

from snac import SNAC
from inference import load_ke_model, synthesise
import soundfile as sf
snac_model = SNAC.from_pretrained("hubertsiuzdak/snac_24khz")
model, tokenizer, lexicon = load_ke_model("mucemi/orpheus-ke-lora")
audio = synthesise("Habari, how are you today?", model, tokenizer, lexicon, snac_model)
sf.write("output.wav", audio, 24000)

Requirements

markdown

pip install unsloth snac transformers soundfile accelerate

Details

  • Base model: Orpheus 3B (canopylabs/orpheus-3b-0.1-ft)
  • Method: LoRA (r=32, alpha=32)
  • Audio codec: SNAC 24kHz
  • Quantisation: 4-bit (bitsandbytes)
  • Training: ~45 min on Kaggle T4 GPU

Model provider

mucemi

Model tree

Base

canopylabs/orpheus-3b-0.1-ft

Adapter

this model

Modalities

Input

Text

Output

Text

Pricing

Dedicated Endpoints

View details

Supported Functionality

Model APIs

Dedicated Endpoints

Container

More information

Explore FriendliAI today