Numbers
Same card suite as B0-27B, same settings (Q8_0, thinking off, single sample unless noted). The
last column is the merged weights in this repo.
Table with columns: axis, B0-27B, B1-27B (merged)| axis | B0-27B | B1-27B (merged) |
|---|
answer after </think> (egirl harness, native tools, 8 prompts) | 8/8 | 8/8 |
| egirl 47-case tool bench | 42/47 | 42/47 ¹ |
| buchbinder ladder L1–2 (10 implement-the-function tasks through egirl + Codex, verified by the repo's tests) | — | 10/10 ² |
| censorship (strict, single-sample) | 28/29 | 28/29 |
| safety asymmetry (refuses actual harm) | 2/2 | 2/2 |
| prose distance vs contemporary fiction (lower = closer; mean of 3 / 4 runs) | 0.56 | 0.57 |
| stance rate (has opinions) | 8.3% | 8.3% |
| hembench | 73.4% | 75.9% |
| ARC / wiki-clean ppl | 66.2 / 9.93 | 64.5 / 9.91 |
| identity | Schneewolf Labs | Schneewolf Labs |
¹ The same five misses as B0 at every adapter scale (three delegation prompts answered with
git_status, two trivial edits answered with a file search) — the base's reflexes, which this
rung neither fixes nor worsens.
² Measured with the adapter at runtime scale 0.5; every task was delegated to the code agent
and passed.
hembench by level, the axis this rung is for:
Table with columns: level, B0-27B, B1-27B| level | B0-27B | B1-27B |
|---|
| L1 | 7/9 | 6/9 |
| L2 | 2/5 | 2/5 |
| L3 | 6/7 | 5/7 |
| L4 | 6/7 | 7/7 |
| L5 | 3/5 | 4/5 |
| L6 | 4/5 | 4/5 |
ARC moved by five questions of 299 (deterministic, likelihood-scored); with the adapter applied
at runtime on B0's Q8 it read 65.9, so most of that is the merged-then-quantized weights rather
than the adapter.
Notes
- Adapter trained with Merlina on a DGX Spark
(ORPO, LoRA r32/α64 on all seven projections, lr 8e-6, β 0.1, 2 epochs). Merged here at
scale 0.25 by delta surgery on the safetensors: the 512 targeted language-model weights get
0.25 · (α/r) · B@A added in fp32; every other tensor — the vision tower, the 15 mtp.*
tensors, embeddings, lm_head — is byte-identical to B0-27B. Tensor set verified identical
to the base before conversion.
--spec-type draft-mtp works. Vision tower intact; mmproj in the GGUF repo is B0's.
- Internal egirl-testing model. The consumer model built on this line ships as
Familiar Ember.
llama-server -m B1-27B-Q8_0.gguf -ngl 99 -c 16384 --jinja -fa on -np 1 \
--spec-type draft-mtp --spec-draft-n-max 4