Selection and test results
- selected training step: 240;
- validation candidates: 8 (4 passed fixed gates);
- held-out test phase-balanced exactness: 0.9826;
- held-out action exactness: 0.9783;
- held-out broadcast exactness: 0.9869;
- held-out unsupported-broadcast rate: 0.0000.
Frozen arena results
- strict broadcast rate: 1.0000;
- strict generated-condition action rate: 1.0000;
- generated-condition mean oracle regret: 2.2250;
- generated-condition mean environment reward: 0.4200;
- generated-minus-dropped reward: 0.3858;
- paired coordination-improvement claim gate: false.
The claim gate requires 95% paired intervals to support all three: lower oracle
regret than the untouched base model, generated messages beating dropped
messages, and generated messages beating shuffled messages. A false result is
reported as a negative or inconclusive experiment, not relaxed post hoc.
Reproducibility
- source commit:
f1fd20fb;
- training run: https://wandb.ai/ChinmayK0604/swarm-arena-sft/runs/o0ioy6jt;
- environment:
arena-core-v1;
- prompt:
arena-v2-structured-priority;
- arena manifest:
b53bfc523043ec71cc69f851d0819511c5a9f0b4f09520898f30954bbe874b29;
- deterministic generation with thinking disabled;
- learned artifact: rank-32 PEFT LoRA adapter over Qwen/Qwen3-4B-Instruct-2507.
The results/ directory contains the frozen selection decision and final test,
arena, and paired-comparison summaries. Raw trajectories are logged separately
as a W&B evaluation artifact.
Intended use
Use for research on structured communication, multi-agent credit assignment,
and controlled MARL within the discrete Swarm Arena simulator. Do not interpret
the abstract graph actions as real network-security capabilities.