GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
Tuwhy
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
Tuwhy
Model Tree
allenai/Olmo-3-7B-Instruct
Input Modalities
Output Modalities
Supported Functionality
Install torch, accelerate, and transformers>=4.57.1.
Use the included original OLMo Instruct chat template.
python
import torchfrom transformers import AutoModelForCausalLM, AutoTokenizer model_id = "Tuwhy/Olmo-3-7B-Instruct-OPSA-Code"tokenizer = AutoTokenizer.from_pretrained(model_id)model = AutoModelForCausalLM.from_pretrained( model_id, torch_dtype=torch.bfloat16, device_map="auto",)messages = [{"role": "user", "content": "Write a Python function that checks whether a string is a palindrome."}]inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt",).to(model.device)outputs = model.generate( **inputs, max_new_tokens=2048, do_sample=True, temperature=0.7, top_p=0.8, top_k=20,)print(tokenizer.decode(outputs[0, inputs["input_ids"].shape[1]:], skip_special_tokens=True))