GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
sylvester-francis
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
sylvester-francis
Model Tree
deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
Input Modalities
Output Modalities
Supported Functionality
This variant includes chain-of-thought reasoning for better code understanding and generation.
python
from transformers import AutoTokenizer, AutoModelForCausalLMfrom peft import PeftModel base_model = "deepseek-ai/DeepSeek-R1-Distill-Qwen-7B"model = AutoModelForCausalLM.from_pretrained( base_model, device_map="auto", torch_dtype="auto")tokenizer = AutoTokenizer.from_pretrained(base_model) # Load LoRA adaptermodel = PeftModel.from_pretrained(model, "sylvester-francis/typescript-slm-7b-reasoning") # Generate codeprompt = "Write a React component with TypeScript:"inputs = tokenizer(prompt, return_tensors="pt").to(model.device)outputs = model.generate(**inputs, max_new_tokens=512)print(tokenizer.decode(outputs[0]))