💡 What is this model?
The goal was to combine two complementary strengths into one lightweight model:
- Knowledge and reasoning: Multi-step problem-solving, mathematics, STEM knowledge, and structured answers.
- Coding and agents: Code generation, debugging, tool use, function calling, and agent workflows.
- Unrestricted behavior: Both parent models are decensored Heretic variants. Abliterated behavior has also been confirmed in the merged model.
The model was created through weight-space merging using SLERP (Spherical Linear Interpolation), rather than additional fine-tuning.
🧬 Merge Details
Table with columns: Setting, Value| Setting | Value |
|---|
| Merge method | SLERP |
| Interpolation parameter | t = 0.4 |
| First model (higher weight) | xtools-at/Qwopus3.5-4B-Coder-UNCENSORED-heretic |
| Second model | xtools-at/DeepSeek-V4-Pro-Qwen3.5-4B-UNCENSORED-heretic |
With t = 0.4, the first parent receives the higher interpolation weight, giving the merge a stronger coding and agent-oriented foundation while incorporating the reasoning strengths of the second model.
🧠 Parent Models
1. Qwopus3.5-4B-Coder-UNCENSORED-heretic
Model repository · Original Jackrong fine-tune
A Qwen3.5-based coding and agent model focused on practical programming workflows, debugging, bug localization, code patches, tool routing, and function calling.
Its training combines reconstructed Claude reasoning traces with agent trajectories from real-world coding and tool-use tasks.
2. DeepSeek-V4-Pro-Qwen3.5-4B-UNCENSORED-heretic
Model repository · Original Jackrong fine-tune
A Qwen3.5-based reasoning model distilled from DeepSeek-V4-Pro in Max Effect mode. Its fine-tuning uses approximately 250K mathematics and STEM samples, focusing on structured derivations, problem decomposition, and scientific reasoning.
🔓 About Decensoring
Both parent models are Heretic-based decensored variants. The merged checkpoint has also been tested, and its abliterated behavior has been confirmed.
📚 Training Data & Origins
The parent models draw on different training-data sources:
Mathematics & STEM
The DeepSeek-based parent uses approximately 250K mathematics and STEM examples distilled from DeepSeek-V4-Pro. Its model card does not identify a separate public dataset repository.
Claude Trace Inversion
The Qwopus parent references two reconstructed reasoning datasets:
These datasets use Trace Inversion to reconstruct detailed synthetic reasoning traces from problems, answers, and compressed summaries. They are reconstructed training data, not direct access to private internal reasoning traces.
Research reference: How to Steal Reasoning Without Reasoning Traces.
Agent & Tool-Use Data
lambda/hermes-agent-reasoning-traces provides multi-turn agent trajectories originating from Kimi-K2.5 and GLM-5.1-FP8. The examples cover tool calling, terminal operations, coding, repository work, and browser automation.
🛠️ Intended Use
This model is intended for experimentation and local use, particularly:
- General reasoning and multi-step problem-solving.
- Mathematics and scientific questions.
- Code generation, debugging, and refactoring.
- Tool calling and agent-oriented workflows.
- General-purpose conversational assistance.
As a compact class model, it aims to provide a useful balance between capability and local deployment requirements.
📊 Preliminary evaluation
Due to resource constraints, this initial evaluation was limited to the 4B variant, comparing it to the upstream parent models, using a small set of benchmarks.
The results suggest that the merge has largely preserved general benchmark performance, with no clear indication of overall degradation. Scores shifted slightly across tasks, with this model performing similarly to its parents on ARC-Easy and doing slightly better on the ARC-Challenge benchmark, and closing the gap between the parents on GSM8K.
This is a preliminary assessment rather than a comprehensive evaluation. Testing may be expanded in the future, including runs on the 9B model and additional specialized STEM, SWE and Terminal benchmarks.
Results
Best score per task is in bold. All models loaded with BNB 4-bit quantization. Full test splits were used for all tasks.
⚠️ Limitations
This is an experimental community merge, not a newly trained or comprehensively evaluated foundation model.
Benchmark results reported by the parent models should not be interpreted as results for this merged checkpoint. Merging can affect the performance and behavior of both parents, and the resulting model has not been independently benchmarked.
The decensored and abliterated behavior also means that refusal patterns and safety boundaries may differ from conventional instruction-tuned models. Generated code and tool calls should be reviewed before use in real environments.
📄 License & Acknowledgements
Both immediate parent model repositories declare Apache-2.0 licensing. The referenced datasets also list Apache-2.0 in their Hugging Face metadata. Please review the original repositories and applicable third-party data terms when redistributing or using the model commercially.
Full credit goes to the original authors and contributors:
- Qwen Team — Qwen3.5 foundation models.
- Jackrong — DeepSeek distillation, Qwopus, and trace-inversion work.
- Lambda — Hermes Agent reasoning traces.
- Heretic — Model decensoring and ablation tooling.
Thanks to everyone involved in making these models, datasets, and tools available to the community. ❤️