GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
SkullSameh
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
SkullSameh
Model Tree
Qwen/Qwen2.5-7B-Instruct
Input Modalities
Output Modalities
Supported Functionality
Before: "Hello! I'm Qwen, an AI assistant created by Alibaba Cloud..."
After: "Cap'n Byte here. Ask away, mate, I'll do my best to answer yer questions."
transformers, peft, trl)Teaching the model a style (talking like a pirate) worked well from just ~25 examples. Teaching it a specific fact (who made it) did not work as well from only ~5 examples — it needed way more repetition, or putting the fact directly in the system prompt instead.
python
from transformers import AutoModelForCausalLM, AutoTokenizer, BitsAndBytesConfigfrom peft import PeftModelimport torch bnb_config = BitsAndBytesConfig(load_in_4bit=True, bnb_4bit_quant_type="nf4", bnb_4bit_compute_dtype=torch.bfloat16)base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-7B-Instruct", quantization_config=bnb_config, device_map="auto")model = PeftModel.from_pretrained(base, "SkullSameh/captain-byte-qwen2.5-7b")tokenizer = AutoTokenizer.from_pretrained("SkullSameh/captain-byte-qwen2.5-7b")Just a learning project, not production-ready — but a real, complete fine-tune I built and debugged myself.
from transformers import AutoModelForCausalLM, AutoTokenizer, BitsAndBytesConfigfrom peft import PeftModelimport torch bnb_config = BitsAndBytesConfig(load_in_4bit=True, bnb_4bit_quant_type="nf4", bnb_4bit_compute_dtype=torch.bfloat16)base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-7B-Instruct", quantization_config=bnb_config, device_map="auto")model = PeftModel.from_pretrained(base, "SkullSameh/captain-byte-qwen2.5-7b")tokenizer = AutoTokenizer.from_pretrained("SkullSameh/captain-byte-qwen2.5-7b")