GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
Jayi2424
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
Jayi2424
Model Tree
Qwen/Qwen2.5-7B-Instruct
Input Modalities
Output Modalities
Supported Functionality
| Property | Value |
|---|---|
| Stage | Supervised Fine-Tuning (SFT) |
| Backbone | Qwen2.5-7B-Instruct (QLoRA 4-bit) |
| LoRA r / alpha | 16 / 16 |
| Data | SemEval-2026 MWAHAHA + CSF persona traces |
This is a PEFT LoRA adapter. Load the base model and apply the adapter:
python
from transformers import AutoModelForCausalLM, AutoTokenizerfrom peft import PeftModelimport torch tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen2.5-7B-Instruct")model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-7B-Instruct", torch_dtype=torch.bfloat16, device_map="auto")model = PeftModel.from_pretrained(model, "Jayi2424/HumorGen_SFT_7B") headline = "Scientists discover that staring at spreadsheets increases sadness by 94%"prompt = ( "<|im_start|>system\n" "You are a comedy writer. Write one sharp, witty joke for the headline.\n<|im_end|>\n" f"<|im_start|>user\n{headline}<|im_end|>\n" "<|im_start|>assistant\n")inputs = tokenizer(prompt, return_tensors="pt").to(model.device)outputs = model.generate(**inputs, max_new_tokens=120, temperature=0.9, top_p=0.95)print(tokenizer.decode(outputs[0], skip_special_tokens=True))bibtex
@misc{ajayi2026humorgen, title = {HumorGen: Cognitive Synergy for Humor Generation in Large Language Models via Persona-Based Distillation}, author = {Ajayi, Edward and others}, year = {2026}, eprint = {2604.09629}, archivePrefix = {arXiv}, primaryClass = {cs.CL}, url = {https://arxiv.org/abs/2604.09629}}from transformers import AutoModelForCausalLM, AutoTokenizerfrom peft import PeftModelimport torch tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen2.5-7B-Instruct")model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-7B-Instruct", torch_dtype=torch.bfloat16, device_map="auto")model = PeftModel.from_pretrained(model, "Jayi2424/HumorGen_SFT_7B") headline = "Scientists discover that staring at spreadsheets increases sadness by 94%"prompt = ( "<|im_start|>system\n" "You are a comedy writer. Write one sharp, witty joke for the headline.\n<|im_end|>\n" f"<|im_start|>user\n{headline}<|im_end|>\n" "<|im_start|>assistant\n")inputs = tokenizer(prompt, return_tensors="pt").to(model.device)outputs = model.generate(**inputs, max_new_tokens=120, temperature=0.9, top_p=0.95)print(tokenizer.decode(outputs[0], skip_special_tokens=True))