GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
didiudom94
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
didiudom94
Model Tree
openai/whisper-small
Input Modalities
Output Modalities
Supported Functionality
ko) to English (en)openai/whisper-smallnf4) with double quantizationbf16)You can easily reload this model for inference using the code snippet below:
python
import torchfrom transformers import WhisperForConditionalGeneration, WhisperProcessorfrom peft import PeftModel, PeftConfig model_id = "openai/whisper-small"peft_model_id = "didiudom94/whisper-small-ko-to-en-translator" # Load unified processorprocessor = WhisperProcessor.from_pretrained(peft_model_id) # Load base architecture in low-precisionbase_model = WhisperForConditionalGeneration.from_pretrained( model_id, load_in_4bit=True, device_map="auto") # Merge fine-tuned LoRA weightsmodel = PeftModel.from_pretrained(base_model, peft_model_id)