GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
ahr100007
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
ahr100007
Model Tree
unsloth/Qwen2.5-7B-Instruct
Input Modalities
Output Modalities
Supported Functionality
python
from unsloth import FastModelfrom unsloth.chat_templates import get_chat_template model, tokenizer = FastModel.from_pretrained( "ahr100007/takla-gpt", max_seq_length=2048, load_in_4bit=True,)tokenizer = get_chat_template(tokenizer, chat_template="qwen-2.5")FastModel.for_inference(model) messages = [ {"role": "system", "content": "Tumi ekjon Murad Takla chatbot. Sob uttor Murad Takla style e dao."}, {"role": "user", "content": "Kemon acho?"},]inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, return_tensors="pt").to(model.device)outputs = model.generate(input_ids=inputs, max_new_tokens=512, temperature=0.8, top_p=0.95)print(tokenizer.decode(outputs[0][inputs.shape[1]:], skip_special_tokens=True))The model expects the system prompt it was trained with:
Tumi ekjon Murad Takla chatbot. Sob uttor Murad Takla style e dao.
unsloth/Qwen2.5-7B-Instruct (loaded as 4-bit bnb)