zc88

qwen0.5b-alpaca-lora

Deploy Dedicated

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Model Details

Model Provider

zc88

Model Tree

Base

Qwen/Qwen2.5-0.5B

Adapter

this model

Input Modalities

Text

Output Modalities

Text

Supported Functionality

Dedicated Endpoints

Explore FriendliAI today

Get started Talk to an engineer

README

License: apache-2.0

Usage

python

from peft import PeftModelfrom transformers import AutoModelForCausalLM, AutoTokenizer base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-0.5B")model = PeftModel.from_pretrained(base, "zc88/qwen0.5b-alpaca-lora")tokenizer = AutoTokenizer.from_pretrained("zc88/qwen0.5b-alpaca-lora")

Part of llm-bootcamp Day 7.