Stages
Apply the stages in this order. Each stage was trained on the model produced by the previous one.
How to use
import torchfrom transformers import AutoModelfrom peft import PeftModelĀ model = AutoModel.from_pretrained("ThakiCloud/Qwen3.8-27B-Human-KO-Enterprise-v0.1", torch_dtype=torch.bfloat16)model = PeftModel.from_pretrained(model, "ThakiCloud/Qwen3.8-27B-Human-KO-Enterprise-Boundary-LoRA").merge_and_unload() # stage 3: boundary-sft
How we checked these are the right adapters
For 4 randomly chosen LoRA target tensors we compared the published merged weights minus ThakiCloud/Qwen3.8-27B-Human-KO-Enterprise-v0.1 with the adapter deltas (scale x B x A).
The median cosine is 0.849. Rounding the merged weights to bf16 keeps it below 1; an adapter that was not used scores about 0.
Notes
adapter_config.json names the public model each stage was trained on. Training used a local copy of the same weights, and the adapter weights are unchanged.
- This stage was trained on the backbone without the causal-LM wrapper (PEFT task type FEATURE_EXTRACTION), together with a pointer head that ships in the merged repo as pointer_head.pt. Load it on AutoModel as below; for generation use the merged repo.
License
Same as ThakiCloud/Qwen3.8-27B-Human-KO-Enterprise-Boundary: apache-2.0.