Measured effect (paired against the parent, identical evaluation items)
Parent vs this model, precision used for both: bf16. Evaluation suite digest 3865a9dda944, sweep-size evaluation (PIQA/ARC: 400 items each, zero-shot log-likelihood; synthetic probes: 160 items each, few-shot, seeded).
Table with columns: metric, parent, this model| metric | parent | this model |
|---|
| wikitext-2 test perplexity (1024-token windows) | 13.853 | 16.872 |
| pile-10k sample perplexity (512 tokens) | 11.516 | 14.005 |
| PIQA acc_norm | 0.672 | 0.675 |
| ARC-Easy acc_norm | 0.583 | 0.512 |
| ARC-Challenge acc_norm | 0.357 | 0.300 |
| swap-tracking (chance 0.25) | 0.344 | 0.250 |
| location-tracking (chance 0.20) | 0.625 | 0.581 |
| multi-step variable arithmetic, ranked (chance 0.20) | 0.494 | 0.406 |
| multi-step greedy-generation exact match (n=80) | 0.338 | 0.287 |
Paired change in wikitext loss: +0.197 +/- 0.008 nats/token (95% CI). Probe accuracies have 95% CIs of roughly +/-0.04 (PIQA/ARC) to +/-0.12 (synthetic probes); differences smaller than that are noise.
Evaluation was run through an in-memory layer view of the parent; on the 8B recipe this was verified to be bit-identical to loading the written checkpoint.
Caveats
- No healing; expect degraded fluency and reasoning. Do not use as a drop-in replacement for the parent.
- Evaluated only on the tasks above (no MMLU, HellaSwag, WinoGrande, safety or instruction-following evaluation).
- Weights inherit the parent's Apache-2.0 license; no additional training data was used.
Provenance and code
Produced by the laco-lab subproject (CLI lacolab, 81 tests, audit of Mercity's LaCo-8B, full report and experiment manifest) in the jev-qwen repository of MoralityLabAI (branch add/laco-lab-layer-compression). Rebuild: lacolab compress --model Qwen/Qwen3-0.6B-Base --recipe runs/c06/d3.json --out <dir>.