Provenance

json
Copy code
{
  "source": "/workspace/glm5-fp8-clean",
  "directions": "/workspace/output/label_colored_residual_directions.pt",
  "n_layers": 78,
  "max_weight": 2.0,
  "min_weight": 1.0,
  "max_weight_position": 51.480000000000004,
  "min_weight_distance": 39.0,
  "affected_layers": [
    13,
    14,
    15,
    16,
    17,
    18,
    19,
    20,
    21,
    22,
    23,
    24,
    25,
    26,
    27,
    28,
    29,
    30,
    31,
    32,
    33,
    34,
    35,
    36,
    37,
    38,
    39,
    40,
    41,
    42,
    43,
    44,
    45,
    46,
    47,
    48,
    49,
    50,
    51,
    52,
    53,
    54,
    55,
    56,
    57,
    58,
    59,
    60,
    61,
    62,
    63,
    64,
    65,
    66,
    67,
    68,
    69,
    70,
    71,
    72,
    73,
    74,
    75,
    76,
    77
  ],
  "include_mlp_down_proj": false,
  "method": "direct_weight_surgery_fp8_block_quant"
}

The label-colored residual direction bundle used for the surgery is included at abliteration/label_colored_residual_directions.pt.

Loading

Loads as a standard GLM-5.1-FP8 checkpoint (same architecture/config as the base). Use the same runtime you would use for zai-org/GLM-5.1-FP8 (e.g. vLLM / SGLang with FP8 MoE support, or transformers with CPU offload).