GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
tahasiddiqui7
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
tahasiddiqui7
Model Tree
Qwen/Qwen2.5-0.5B-Instruct
Input Modalities
Output Modalities
Supported Functionality
This model is intended for general instruction-following, basic reasoning, text generation, and conversational Q&A.
Use the code below to load and run inference with this model:
python
import torchfrom transformers import AutoModelForCausalLM, AutoTokenizerfrom peft import PeftModel base_model_id = "Qwen/Qwen2.5-0.5B-Instruct"peft_model_id = "tahasiddiqui7/Qwen2.5B" tokenizer = AutoTokenizer.from_pretrained(peft_model_id)base_model = AutoModelForCausalLM.from_pretrained( base_model_id, torch_dtype=torch.float16, device_map="auto") # Load fine-tuned LoRA adapter onto base modelmodel = PeftModel.from_pretrained(base_model, peft_model_id) prompt = "### Instruction:\nExplain the concept of fine-tuning in machine learning.\n\n### Response:\n"inputs = tokenizer(prompt, return_tensors="pt").to(model.device) outputs = model.generate(**inputs, max_new_tokens=128, temperature=0.7)print(tokenizer.decode(outputs[0], skip_special_tokens=True))