What it is
- Base:
Qwen/Qwen3-1.7B (Apache-2.0).
- Training: MLX-LM BF16 LoRA, 8 last layers, rank 16, scale 16, dropout 0.05,
100 iterations, batch 1, max sequence 1280.
- Prompt during training: compact system prompt plus one-line tool descriptions
(1118 tokens, 13 tools: battery, Wi-Fi status/connect, services list, service logs,
service restart, sleep inhibit, volume get/set/step, mute, brightness set/step).
- Data: ~610 synthetic Russian requests and refusals, generated by DeepSeek V4.1 Flash
(AI-generated), filtered against the agent's frozen test sets.
- Artifacts here: PEFT LoRA adapter and GGUF Q4_K_M.
Evaluation
temperature 0, compact prompt, GGUF Q4_K_M. Sets are Russian tool-selection queries
with exact expected tool and arguments.
Table with columns: Set, Correct tool, With arguments| Set | Correct tool | With arguments |
|---|
| frozen 148-query set | 131/148 (89%) | 125/148 (84%) |
| held-out 40 (v2) | 33/40 (82%) | 32/40 (80%) |
| held-out 40 (v3) | 32/40 (80%) | 27/40 (68%) |
| held-out 40 (v4) | — | — |
With the kuzya rules layer (deterministic pre-routing and argument repair in the
agent, not in these weights) the same model scores 98–100% on the fresh sets:
40/40 on held-out v4 and v3 and 40/40 on v2. Do not attribute those numbers to the
weights alone.
Phone (Poco F1, Q4_K_M): peak RAM 1.71 GB, load 3–4 s, warm energy 8.9 J per query with
rules (30.7 J without rules), mean 2.4 s per query with rules.
Limitations
- Relative vs absolute volume and brightness ("потише" with a number) is fragile.
mute_set and nosleep_set on/off can be inverted without the agent rules.
- A line count can be mistaken for a service name in
service_logs.
- Out-of-scope requests (Wi-Fi on/off, ssh/sshd, "all services", arithmetic) may produce
a tool call; the agent's allowlist and rules catch them.
- Evaluated only on Russian queries and only on one phone model.
Data and licence
- Weights: Apache-2.0 (same as the base model).
- Training data is synthetic, generated by DeepSeek V4.1 Flash through its API under the
DeepSeek Open Platform Terms of Service (release 2026-04-22, §4.2(3), which permits
using outputs to train other models). It is AI-generated; no data from the phone,
no personal data.
- DeepSeek is mentioned only as the data source; this model is not affiliated with or
endorsed by DeepSeek.
Links