GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
SinhalaMMLU-SharedTask
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
SinhalaMMLU-SharedTask
Model Tree
google/gemma-4-E4B-it
Input Modalities
Output Modalities
Supported Functionality
The recipe is in inference.py of the team repo: thinking on, a subject and grade line, 8 greedy answers over shuffled options with a majority vote, and a 7,168-token thinking budget, with vLLM 0.32.0 on one A100 40 GB. A minimal Transformers load:
python
import torchfrom transformers import AutoModelForImageTextToText, AutoTokenizer model_id = "SinhalaMMLU-SharedTask/team-rexx-gemma-4-e4b"tokenizer = AutoTokenizer.from_pretrained(model_id)model = AutoModelForImageTextToText.from_pretrained(model_id, dtype=torch.bfloat16, device_map="auto").eval()