ManniX-ITA

JackOD-9B-Coder

README

License: apache-2.0

Where the name comes from

JackOD is an initialism of its three merge sources:

Table with columns: letter, source
letter	source
Jack	`Jackrong/Qwopus3.5-9B-coder` — JackRong's Qwopus 9B
O	`ornith-ai/Ornith-1.5-9B`
D	`danielcherubini/Qwen3.5-DeltaCoder-9B`

Qwen3.5-9B is not in the name: it is the shared ancestor all three descend from, the --base/--task-base the merge is taken against, rather than a flavour contributed to the blend.

Field impression — initial, limited testing

This section is the author's early hands-on impression from a small number of runs, not a benchmark result. It is reported because it is the reason the model exists, and it should be read as an anecdote until a proper harness campaign replaces it.

Verification against the cline test harness is still in progress. So far it has fixed a task in 535 s on the harness; a second run went to timeout. It also fixed the task on a separate machine through the plugin.

For comparison, on the same task, A3B-class models typically take 1.5–4 h with a success rate below 50%. The one exception is Ornith-1.5-27B-A3B, which has a high success rate but still needs ~2 h or more per task.

That gap — minutes rather than hours, from a 9B dense model — is what this merge was assembled to get. It is an early signal from few runs, and the sample is far too small to quote a success rate of its own.

Recipe

Full reproducible chain, including the scripts that built it: recipes/jackod-9b-coder/ in omnimergekit.

bash
python omnimergekit.py \
  --base      Qwen3.5-9B --task-base Qwen3.5-9B \
  --source    DeltaCoder-9B-applied \
  --source    Qwopus3.5-9B-Coder \
  --source    Ornith-1.5-9B \
  --weights   0.55,0.30,0.15 \
  --method omnimerge_v2 --density 0.53 --darex-q 0.75 --seed 42 \
  --no-auto-mlp-skip --skip-patterns visual.,mtp. \
  --output JackOD-9B-Coder

One step is not optional: Qwen3.5-9B and DeltaCoder-9B-applied carry no root eos_token_id (it lives only in the nested text config). The GGUF converter reads the root, finds nothing, and falls back — putting the wrong terminator in the quant and leaking control tokens into generations. patch_jackod.py copies the root EOS, tokenizer and chat template from Qwopus, whose chat template this model serves.

Evaluation

Q6_K + imatrix, llama.cpp, greedy (sampler=template_default, temp 0.0 / top-p 1.0 / top-k 0). Scores read from summary.json.score. The LiveCodeBench row is lcb_v6_55 throughout — lcb_medium_55 is a different problem set and is never mixed in.

Table with columns: Benchmark, JackOD-9B-Coder, Qwen3.5-9B (base), DeltaCoder-9B (0.55), Qwopus3.5-9B-Coder (0.30), Ornith-1.5-9B (0.15)
Benchmark	JackOD-9B-Coder	Qwen3.5-9B (base)	DeltaCoder-9B (0.55)	Qwopus3.5-9B-Coder (0.30)	Ornith-1.5-9B (0.15)
HumanEval (164)	0.8841	0.8902	0.9146	0.8537	0.7805
HumanEval+ (164)	0.8232	0.8049 †	0.8232	0.7988	0.7073

† The base's HumanEval+ and IFEval cells come from an earlier 9B bank rather than the cohort pod run. That bank agrees with the cohort exactly on HumanEval (0.8902 both) but differs on MultiPL-E by 1.67 pp, so treat those two base cells as indicative rather than same-basis.

LiveCodeBench is the real result: 0.7818 beats every source and the base. +5.45 pp over the strongest source (the base itself) and +14.54 pp over DeltaCoder, the 0.55-weight source the merge leans on hardest. On the hard problems the merge is not splitting the difference between its parents — it is above all of them.

Elsewhere it lands where a merge should: identical to DeltaCoder on HumanEval+ (0.8232 both), a little under it on HumanEval (−3.05 pp, 5 problems of 164) and IFEval, a little under the base on MultiPL-E (−1.67 pp). Those are give-backs, and small ones.

Length and runaway behaviour — where the merge actually comes from

Response length in characters on lcb_v6_55, the same 55 hard problems under an identical cap. capped = finish_reason == "length": the model never terminated on its own.

Table with columns: model, capped / 55, p50, p90, max, >20k
model	capped / 55	p50	p90	max	>20k
DeltaCoder-9B (0.55)	25	37,524	50,555	77,590	54
Qwen3.5-9B (base)	18	37,984	49,376	53,564	53
Qwopus3.5-9B-Coder (0.30)	8

This table is the thesis of the merge. Read next to the eval table above, the two heaviest sources split cleanly along opposite axes:

DeltaCoder is the best coder in the cohort (HumanEval 0.9146) and the worst at stopping — 25 of 55 hard problems never terminate.
Ornith-1.5-9B is the weakest coder (LiveCodeBench 0.5818, HumanEval 0.7805) and by far the best at stopping — 2 of 55.
JackOD takes both: the best LiveCodeBench score of the entire cohort and the best termination rate, 1 of 55.

Against the base that is an 18× reduction in non-terminating generations; against DeltaCoder, its heaviest source, 25×. A capped generation is a scoring failure regardless of whether the reasoning was on track, so this is not a separate nicety — it is a large part of why the LiveCodeBench number is what it is.

Other benches, all on the published Q6_K:

Table with columns: Benchmark, p50, p90, max, >20k
Benchmark	p50	p90	max	>20k
HumanEval (164)	590	1,192	60,219	1
HumanEval+ (164)	590	1,182	5,961	0
MultiPL-E (300)	257	539	1,007	0

Earlier attempts in this family — do not use them for agentic work

This merge went through several earlier arms. They are listed here because their numbers are in circulation and, read as a table, they are misleading.

Table with columns: arm, HumanEval, HumanEval+, LCB v6 (55), MultiPL-E, IFEval, capped / 55
arm	HumanEval	HumanEval+	LCB v6 (55)	MultiPL-E	IFEval	capped / 55
JackOD-Coder-9B	0.8232	0.7683	0.8182	0.7933	0.9300	3
JackOD3.5-9B	0.8659	—	0.7455	—	—

JackOD-Coder-9B scores higher than this model on LiveCodeBench (0.8182 vs 0.7818) and on IFEval, and it is still the wrong model to deploy. That is the point of this section.

In real multi-turn agentic coding — a live tool loop, not a benchmark harness — JackDeltaCoder-9B and every earlier JackOD arm fail:

they do not drive tools properly, mis-forming or skipping tool calls that the task depends on;
they fall into loops, re-treading the same step instead of advancing;
they abandon the task, concluding the problem is too hard to solve and stopping without a fix.

None of that is visible in a single-shot code benchmark, which is exactly why their benchmark rows look competitive. A one-shot HumanEval or LiveCodeBench problem never asks a model to call a tool, read the result, and decide what to do on turn seven. The only arm in this family that holds up in a live agentic loop is the published one. Treat the rows above as a record of what was tried, not as a menu.

Tool calling — `tool-eval-bench` hardmode

88 scenarios offered, 84 scored, 168 points. 5 paired seeds (42–46) per arm, n=5 → t=2.776, greedy, --hardmode --weight-by-difficulty, scorer 2.6.1.dev65+g6be685f0e, served by llama.cpp 5bda51bf with --jinja. Every arm shares that basis exactly.

Tool-calling benchmark

Table with columns: model, role, total points (mean, 5 seeds), 95% CI
model	role	total points (mean, 5 seeds)	95% CI
Ornith-1.5-9B	source	145.6 ±4.2	[141.4, 149.8]
JackOD-9B-Coder	merge	144.4 ±4.7	[139.7, 149.1]
Qwen3.5-9B	base	142.0 ±3.9	[138.1, 145.9]
DeltaCoder-9B	source	139.6 ±5.7

On aggregate points this merge does not beat its sources — it is second, and every interval overlaps. It sits above its base and within noise of Ornith. The aggregate is not where the difference lives.

Where it does separate: Autonomous Planning

Table with columns: category, JackOD, Ornith, base, DeltaCoder, Qwopus
category	JackOD	Ornith	base	DeltaCoder	Qwopus
M Autonomous Planning (6)	5.2	2.8	4.8	4.0	3.6
H Instruction Following (10)	9.6	9.2	9.2	8.8	8.0
I Context & State (20)	17.0

Autonomous Planning is the one axis with a clear, consistent edge: 5.2/6, best of all five arms — while Ornith, the top aggregate scorer, is the worst at 2.8/6. The merge reaches Ornith's overall level while fixing exactly Ornith's long-horizon planning weakness.

That pairing is worth sitting with, because Ornith is also the source with the best termination rate (2/55 capped). A model that stops reliably and plans worst than anything else in the cohort looks like one that stops too early — terminating is easy if you give up. The merge is the arm that does both: it carries the goal (5.2/6 planning, best) and still lands the plane (1/55 capped, best). That combination, not either number alone, is what the field impression above is describing.

Categories A/B/D/F (tool selection, parameter precision, restraint & refusal, localization) are 6/6 for every arm and are omitted; G Structured Reasoning and N Creative Composition are 6/6 for all but Qwopus (5.8 and 5.2). Structured Output is 2.0/4 for all five — none of these models clears it.

Serving

generation_config.json ships the serving recipe:

markdown
temperature 0.8 · top_p 0.95 · top_k 20 · min_p 0.05 · repeat_penalty 1.05

Add, where your runtime supports them (ollama and llama.cpp do; HF GenerationConfig has neither field):

markdown
repeat_last_n 96 · presence_penalty 0

The published mannix/JackOD-9B-Coder ollama tags carry exactly this set.

Temperature is not a free parameter here

0.8 is a deliberate middle, because the failure modes sit on both sides of it and they are different failures:

Lower degrades coding ability first. Push it further down and hallucinations and erratic behaviour follow.
Higher makes the model less willing to use its tools — it drifts toward writing its own scratch scripts instead of calling what it already has.

Neither symptom announces itself as a sampler problem, which is why the value is stated rather than left to taste.

On the repetition controls

Earlier revisions of this card recommended presence_penalty 1.5. That has been replaced by repeat_penalty 1.05 over a repeat_last_n 96 window, with presence_penalty back at 0. The job is the same — discouraging the model from re-treading a tool call it already made — but a bounded recent-token window does it without the broad, unbounded pressure a large presence penalty puts on every token the model has ever emitted.

For tool calling, --jinja is mandatory in llama.cpp: without it the tool grammar never comes from the model's chat template and every tool scenario degrades to prose.

Quants

GGUF quants — 25 tiers including the CD ladder, each with a .sha256, and the calibration imatrix archived alongside: ManniX-ITA/JackOD-9B-Coder-MTP-GGUF

Also on ollama: mannix/JackOD-9B-Coder

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Model Details

Model Provider

ManniX-ITA

Model Tree

Base

Qwen/Qwen3.5-9B

Fine-tuned

this model

Input Modalities

TextImageVideo

Output Modalities

Text

Supported Functionality

Dedicated Endpoints

Explore FriendliAI today

Get started Talk to an engineer

README

License: apache-2.0

Where the name comes from

JackOD is an initialism of its three merge sources:

Table with columns: letter, source
letter	source
Jack	`Jackrong/Qwopus3.5-9B-coder` — JackRong's Qwopus 9B
O	`ornith-ai/Ornith-1.5-9B`
D	`danielcherubini/Qwen3.5-DeltaCoder-9B`

Qwen3.5-9B is not in the name: it is the shared ancestor all three descend from, the --base/--task-base the merge is taken against, rather than a flavour contributed to the blend.

Field impression — initial, limited testing

This section is the author's early hands-on impression from a small number of runs, not a benchmark result. It is reported because it is the reason the model exists, and it should be read as an anecdote until a proper harness campaign replaces it.

Recipe

Full reproducible chain, including the scripts that built it: recipes/jackod-9b-coder/ in omnimergekit.

bash
python omnimergekit.py \
  --base      Qwen3.5-9B --task-base Qwen3.5-9B \
  --source    DeltaCoder-9B-applied \
  --source    Qwopus3.5-9B-Coder \
  --source    Ornith-1.5-9B \
  --weights   0.55,0.30,0.15 \
  --method omnimerge_v2 --density 0.53 --darex-q 0.75 --seed 42 \
  --no-auto-mlp-skip --skip-patterns visual.,mtp. \
  --output JackOD-9B-Coder

Evaluation

Table with columns: Benchmark, JackOD-9B-Coder, Qwen3.5-9B (base), DeltaCoder-9B (0.55), Qwopus3.5-9B-Coder (0.30), Ornith-1.5-9B (0.15)
Benchmark	JackOD-9B-Coder	Qwen3.5-9B (base)	DeltaCoder-9B (0.55)	Qwopus3.5-9B-Coder (0.30)	Ornith-1.5-9B (0.15)
HumanEval (164)	0.8841	0.8902	0.9146	0.8537	0.7805
HumanEval+ (164)	0.8232	0.8049 †	0.8232	0.7988	0.7073

Length and runaway behaviour — where the merge actually comes from

Response length in characters on lcb_v6_55, the same 55 hard problems under an identical cap. capped = finish_reason == "length": the model never terminated on its own.

Table with columns: model, capped / 55, p50, p90, max, >20k
model	capped / 55	p50	p90	max	>20k
DeltaCoder-9B (0.55)	25	37,524	50,555	77,590	54
Qwen3.5-9B (base)	18	37,984	49,376	53,564	53
Qwopus3.5-9B-Coder (0.30)	8

This table is the thesis of the merge. Read next to the eval table above, the two heaviest sources split cleanly along opposite axes:

DeltaCoder is the best coder in the cohort (HumanEval 0.9146) and the worst at stopping — 25 of 55 hard problems never terminate.
Ornith-1.5-9B is the weakest coder (LiveCodeBench 0.5818, HumanEval 0.7805) and by far the best at stopping — 2 of 55.
JackOD takes both: the best LiveCodeBench score of the entire cohort and the best termination rate, 1 of 55.

Other benches, all on the published Q6_K:

Table with columns: Benchmark, p50, p90, max, >20k
Benchmark	p50	p90	max	>20k
HumanEval (164)	590	1,192	60,219	1
HumanEval+ (164)	590	1,182	5,961	0
MultiPL-E (300)	257	539	1,007	0

Earlier attempts in this family — do not use them for agentic work

This merge went through several earlier arms. They are listed here because their numbers are in circulation and, read as a table, they are misleading.

Table with columns: arm, HumanEval, HumanEval+, LCB v6 (55), MultiPL-E, IFEval, capped / 55
arm	HumanEval	HumanEval+	LCB v6 (55)	MultiPL-E	IFEval	capped / 55
JackOD-Coder-9B	0.8232	0.7683	0.8182	0.7933	0.9300	3
JackOD3.5-9B	0.8659	—	0.7455	—	—

JackOD-Coder-9B scores higher than this model on LiveCodeBench (0.8182 vs 0.7818) and on IFEval, and it is still the wrong model to deploy. That is the point of this section.

In real multi-turn agentic coding — a live tool loop, not a benchmark harness — JackDeltaCoder-9B and every earlier JackOD arm fail:

they do not drive tools properly, mis-forming or skipping tool calls that the task depends on;
they fall into loops, re-treading the same step instead of advancing;
they abandon the task, concluding the problem is too hard to solve and stopping without a fix.

Tool calling — `tool-eval-bench` hardmode

Tool-calling benchmark

Table with columns: model, role, total points (mean, 5 seeds), 95% CI
model	role	total points (mean, 5 seeds)	95% CI
Ornith-1.5-9B	source	145.6 ±4.2	[141.4, 149.8]
JackOD-9B-Coder	merge	144.4 ±4.7	[139.7, 149.1]
Qwen3.5-9B	base	142.0 ±3.9	[138.1, 145.9]
DeltaCoder-9B	source	139.6 ±5.7

Where it does separate: Autonomous Planning

Table with columns: category, JackOD, Ornith, base, DeltaCoder, Qwopus
category	JackOD	Ornith	base	DeltaCoder	Qwopus
M Autonomous Planning (6)	5.2	2.8	4.8	4.0	3.6
H Instruction Following (10)	9.6	9.2	9.2	8.8	8.0
I Context & State (20)	17.0

Serving

generation_config.json ships the serving recipe:

markdown
temperature 0.8 · top_p 0.95 · top_k 20 · min_p 0.05 · repeat_penalty 1.05

Add, where your runtime supports them (ollama and llama.cpp do; HF GenerationConfig has neither field):

markdown
repeat_last_n 96 · presence_penalty 0

The published mannix/JackOD-9B-Coder ollama tags carry exactly this set.

Temperature is not a free parameter here

0.8 is a deliberate middle, because the failure modes sit on both sides of it and they are different failures:

Lower degrades coding ability first. Push it further down and hallucinations and erratic behaviour follow.
Higher makes the model less willing to use its tools — it drifts toward writing its own scratch scripts instead of calling what it already has.

Neither symptom announces itself as a sampler problem, which is why the value is stated rather than left to taste.

On the repetition controls

For tool calling, --jinja is mandatory in llama.cpp: without it the tool grammar never comes from the model's chat template and every tool scenario degrades to prose.

Quants

GGUF quants — 25 tiers including the CD ladder, each with a .sha256, and the calibration imatrix archived alongside: ManniX-ITA/JackOD-9B-Coder-MTP-GGUF

Also on ollama: mannix/JackOD-9B-Coder

JackOD-9B-Coder

README

Where the name comes from

Field impression — initial, limited testing

Recipe

Evaluation

Length and runaway behaviour — where the merge actually comes from

Earlier attempts in this family — do not use them for agentic work

Tool calling — tool-eval-bench hardmode

Where it does separate: Autonomous Planning

Serving

Temperature is not a free parameter here

On the repetition controls

Quants

Explore FriendliAI today

README

Where the name comes from

Field impression — initial, limited testing

Recipe

Evaluation

Length and runaway behaviour — where the merge actually comes from

Earlier attempts in this family — do not use them for agentic work

Tool calling — tool-eval-bench hardmode

Where it does separate: Autonomous Planning

Serving

Temperature is not a free parameter here

On the repetition controls

Quants

Tool calling — `tool-eval-bench` hardmode

Tool calling — `tool-eval-bench` hardmode