Neura-Tech-AI

Neuron-Distill-Qwen2.5-1.5B

Deploy Dedicated

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Container

Run this model inference with full control and performance in your environment.

Learn more

Get help setting up a custom Dedicated Endpoints.

Talk with our engineer to get a quote for reserved GPU instances with discounts.

README

Merge Details

Merge Method

This model was merged using the TIES merge method using Qwen/Qwen2.5-1.5B-Instruct as a base.

Models Merged

The following models were included in the merge:

Neura-Tech-AI/Qwen2.5-1.5B-Neuron-Identity-Expert

Configuration

The following YAML configuration was used to produce this model:

yaml
base_model: Qwen/Qwen2.5-1.5B-Instruct
dtype: float16
merge_method: ties
modules:
  default:
    slices:
    - sources:
      - layer_range: [0, 28]
        model: Neura-Tech-AI/Qwen2.5-1.5B-Neuron-Identity-Expert
        parameters:
          density: 0.5
          weight: 0.6
      - layer_range: [0, 28]
        model: Qwen/Qwen2.5-1.5B-Instruct
        parameters:
          density: 0.5
          weight: 0.4