GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
YuenWu
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
YuenWu
Model Tree
Qwen/Qwen3-0.6B
Input Modalities
Output Modalities
Supported Functionality
bash
python -m pip install -U "transformers>=4.51.0" accelerate torchhf auth login
This is a gated repository. The Hugging Face account used for downloading must have access to the repository.
python
from transformers import AutoModelForCausalLM, AutoTokenizerrepo_id = "YuenWu/Qwen3-0.6B-wyc"tokenizer = AutoTokenizer.from_pretrained(repo_id)model = AutoModelForCausalLM.from_pretrained(repo_id,torch_dtype="auto",device_map="auto",)messages = [{"role": "user", "content": "Solve: 2 + 3."},]text = tokenizer.apply_chat_template(messages,tokenize=False,add_generation_prompt=True,enable_thinking=True,)inputs = tokenizer([text], return_tensors="pt").to(model.device)generated_ids = model.generate(**inputs, max_new_tokens=256)new_tokens = generated_ids[:, inputs.input_ids.shape[1]:]response = tokenizer.batch_decode(new_tokens, skip_special_tokens=True)[0]print(response)
Set enable_thinking=False in apply_chat_template for non-thinking mode.
Qwen/Qwen3-0.6BQwen3ForCausalLMsafetensorsAutoTokenizer and AutoModelForCausalLMThis model was produced for research and evaluation of safety alignment, mathematical reasoning, and general instruction following. Model outputs may still be incorrect or unsafe. Applications should independently validate outputs and apply safeguards appropriate to their deployment context.