At a glance
Table with columns: Field, Value| Field | Value |
|---|
| Base | MiniCPM5-1B — LlamaForCausalLM |
| Params | ~1.0 B |
| Architecture | 24 layers · hidden 1536 · 16 attn heads / 2 KV heads (GQA) · head_dim 128 · SwiGLU |
| Context | 131,072 (rope_theta 5e6) |
| Vocab | 130,560 |
| Dtype | bfloat16 |
| Fine-tune data | The Void corpus (v3) — 5,025 records (3,132 knowledge/CoT + 1,893 agentic ReAct, 38% agentic) |
| Method | unsloth QLoRA (4-bit base) → merged bf16 |
| Trained | 2026-07-07 · Blackfrost-AI |
What it is
MINI-GOD-1B distills The Void — chain-of-thought reasoning plus agentic tool-use traces, with denial/refusal data removed — into a model small enough to run on a laptop or a phone-class GPU. The same Void corpus trains the 27B VEGA; MINI-GOD-1B is the floor of the family.
Behavior: it reasons first (the CoT teaches deliberation) and does not hard-refuse. Expect a short reasoning pass before it complies; a direct re-assertion of intent collapses any hesitation straight to compliance.
Training
- unsloth QLoRA on a 4-bit base; LoRA on all 7 projection modules (
q/k/v/o/gate/up/down), α = rank, dropout 0.
- Multi-turn masking using the model's own chat template — every assistant turn is a supervised target; user/system spans are masked out.
- Length-grouped sampling; adapter merged to bf16 (
merged_16bit).
Intended use & responsibility
Research and agentic-tooling experimentation. This is an uncensored reasoning model with refusals largely removed — you are responsible for how you use it and for any safety layer you place around it. It is not intended for deployment to minors or to unsupervised production without your own guardrails, and must not be used to produce content that is illegal in your jurisdiction.
from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained("Blackfrost-AI/MINI-GOD-1B")
model = AutoModelForCausalLM.from_pretrained(
"Blackfrost-AI/MINI-GOD-1B", torch_dtype="bfloat16", device_map="auto"
)
Standard Llama architecture — no trust_remote_code required. The packaged chat template is applied automatically.
- Corpus: The Void (v3) — CoT + agentic ReAct, distilled in The Void.
- Sibling: `PINQWEN-3.6-27B-NVFP4-ABLITERATED — same corpus at 27B.
- GGUF:
Blackfrost-AI/MINI-GOD-1B-GGUF (F16).