reaperdoesntknow

DualMind-TKD-Agentic-1.7B

README

License: other

Training lineage

Stage 1: topology-guided knowledge distillation

Student: Qwen/Qwen3-1.7B
Teacher: Qwen/Qwen3-8B
Dataset: 0xZee/dataset-CoT-Advanced-Calculus-268
Training scope: full-model fine-tuning
Objective: supervised cross-entropy plus sparse top-k-and-tail teacher distillation
Structural signals: teacher distribution discrepancy, transition topology, gap-energy diagnostics, and phase-weighted Explore/Examine/Response supervision

Stage 1 was designed to transfer mathematical reasoning behavior while placing additional learning pressure on derivation, verification, and high-discrepancy reasoning transitions.

Stage 2: agentic specialization

Dataset: NousResearch/hermes-function-calling-v1
Training scope: LoRA specialization followed by weight merging
Supervision: assistant and tool-call outputs only
Tool schemas, user messages, and tool-result messages were visible as context but excluded from direct loss
Mathematical replay was mixed into Stage 2 to reduce catastrophic forgetting

The files in this repository contain the merged standalone model. A separate PEFT adapter is not required for inference.

Intended uses

Mathematical and technical reasoning
Structured function calling
Tool-selection experiments
Agent-loop research
Continued supervised or preference optimization
Research on topology-aware distillation

Tool execution

This model can generate tool calls, but it does not execute external tools by itself.

A surrounding runtime must:

Parse the model's tool call.
Execute the selected tool.
Append the tool result to the conversation.
Invoke the model again for its next action or final response.

Loading

python
from transformers import AutoModelForCausalLM, AutoTokenizer

repo_id = "reaperdoesntknow/DualMind-TKD-Agentic-1.7B"

tokenizer = AutoTokenizer.from_pretrained(repo_id)

model = AutoModelForCausalLM.from_pretrained(
    repo_id,
    torch_dtype="auto",
    device_map="auto",
)
Evaluation status

No formal benchmark results are claimed in this release.

The training pipeline includes held-out loss monitoring and qualitative
generation smoke tests, but external mathematics, function-calling,
retention, and safety benchmarks should be run before production use.

Limitations
The source mathematics dataset is small.
Synthetic or generated reasoning traces may contain incorrect
derivations or contradictory final answers.
Function-call formatting does not guarantee correct tool selection.
External tool outputs must be treated as untrusted input.
Mathematical replay reduces forgetting but does not prove retention.
The model has not been established as safe for autonomous,
high-impact, medical, financial, or legal action.
License note

The Qwen3-1.7B base model uses Apache-2.0 licensing. The Hermes
function-calling dataset also declares Apache-2.0.

The advanced-calculus dataset did not expose a clear license declaration
when this model card was prepared. Consequently, this repository is
temporarily marked license: other. Confirm the source dataset's reuse
terms before assigning a more permissive license to this derivative.

Developer

Convergent Intelligence LLC / Reaper
Hugging Face: reaperdoesntknow
<!-- cix-keeper-ts:2026-07-29T13:15:34Z -->

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Container

Run this model inference with full control and performance in your environment.

Learn more

Model Details

Model Provider

reaperdoesntknow

Model Tree

Base

Qwen/Qwen3-1.7B

Fine-tuned

this model

Input Modalities

Text

Output Modalities