GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
kabachuha
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
kabachuha
Model Tree
kabachuha/Gemma-4-The-Deckards-Brain-31B
Input Modalities
Output Modalities
Supported Functionality
NVFP4-quantized version of kabachuha/Gemma-4-The-Deckards-Brain-31B, a merge of two heretic Gemma 4 31B dense models with thinking capabilities.
Calibration was done on r/writingprompts story continuations using the modelopt library.
For 5090: Assuming you don't run heavy processes, you can easily fully fit up to ~49000 tokens context into a single GPU. This gives around 60+ tokengen/s.
Convertation to GGUF is made easily with llama.cpp's convert_hf_to_gguf.py.
The prompt format is fully inherited from DavidAU's The Deckard Thinking, meaning the chat template will have thinking by default. To disable, override the chat template with chat_template-instruct.jinja.
Thinking is highly recommended to not be ever turned off! If you are role-playing in non-English, this is crucial to bring your language output distribution closer to the English/Japanese training set, otherwise it will be much more bland and more censored!
For the rest of the information, see the original model card.