GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
Ibackup
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
Ibackup
Model Tree
deepseek-ai/DeepSeek-V4.1-Flash
Input Modalities
Output Modalities
Supported Functionality
transformers workflows, vLLM, and TensorRT-LLM engines.python
import torchfrom PIL import Imagefrom transformers import AutoProcessor, AutoModelForCausalLMmodel_id = "your-username/DeepSeek-V4.1-Flash-FP8"processor = AutoProcessor.from_pretrained(model_id)model = AutoModelForCausalLM.from_pretrained(model_id,torch_dtype=torch.bfloat16,device_map="auto")image = Image.open("example.jpg")prompt = "<image>\nDescribe the image in detail."inputs = processor(text=prompt, images=image, return_tensors="pt").to(model.device)with torch.no_grad():outputs = model.generate(**inputs, max_new_tokens=512)response = processor.decode(outputs[0], skip_special_tokens=True)print(response)