GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
Vortecks
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
Vortecks
Model Tree
ai9stars/G9v3-3B
Input Modalities
Output Modalities
Supported Functionality
G9v3-3B is a dense 3B causal language model from the AI9Stars team, built for local deployment and resource-constrained scenarios. It targets everyday assistant use, coding, tool-use workflows, and reasoning tasks where a compact model is preferred.
This build is a heretic abliterated variant, meaning the refusal directions in the model's activation space have been identified and ablated to remove built-in refusal behavior. As a result, this version is marketed as uncensored and will generally comply with a wider range of prompts than the base instruction-tuned release, without the usual safety-alignment guardrails.
LlamaForCausalLM| Metric | This model | Original model (ai9stars/G9v3-3B) |
|---|---|---|
| KL divergence | 0.0843 | 0 |
| Refusals | 3/100 | 100/100 |
GGUF quantizations of G9v3-3B-Heretic-Abliterated, for use with llama.cpp, Ollama, LM Studio, and other GGUF-compatible runtimes. The example commands below use the Q4_K_M quantization — swap in whichever quant level you've downloaded from the Files and versions tab.
bash
# Build or install llama.cpp: https://github.com/ggml-org/llama.cpphuggingface-cli download Vortecks/G9v3-3B-Heretic-Abliterated-GGUF G9v3-3B-Heretic-Abliterated-Q4_K_M.gguf --local-dir .
CLI (interactive chat):
bash
llama-cli -m G9v3-3B-Heretic-Abliterated-Q4_K_M.gguf \-c 131072 \-cnv \--temp 0.7 \--top-p 0.95
Server (OpenAI-compatible API):
bash
llama-server -m G9v3-3B-Heretic-Abliterated-Q4_K_M.gguf \-c 131072 \--port 8080
bash
curl http://localhost:8080/v1/chat/completions \-H "Content-Type: application/json" \-d '{"messages": [{"role": "user", "content": "Who are you?"}],"max_tokens": 128,"temperature": 0.7}'
bash
ollama run hf.co/Vortecks/G9v3-3B-Heretic-Abliterated-GGUF:Q4_K_M
Search for Vortecks/G9v3-3B-Heretic-Abliterated-GGUF directly in the LM Studio model search, or download a .gguf file from the Files and versions tab and load it manually via Load Model from File.
Recommended sampling parameters:
| Mode | Recommended params |
|---|---|
| Think | temperature=0.9, top_p=0.95 |
| No Think | temperature=0.7, top_p=0.95 |
G9v3-3B is a language model that generates content based on learned statistical patterns from training data. It may produce inaccurate, biased, or unsafe outputs, and generated content should be reviewed and verified before use in high-stakes settings. Users are responsible for evaluating outputs, applying appropriate safeguards, and complying with applicable laws, regulations, and platform policies. As an abliterated, uncensored build, this model has had its built-in refusal behavior removed and will generally comply with a wider range of prompts than its base counterpart, so downstream safety, moderation, and policy compliance must be implemented by the deployer rather than relying on the model itself.
This repository and the G9v3 model weights are released under the Apache-2.0 License.