Spexcon S1 v0.4 Pilot Adapter
This repository contains the experimental Spexcon S1 v0.4 pilot LoRA adapter. It is not the full Spexcon S1 release and should not be treated as a production-quality model.
- Base model:
Qwen/Qwen3-1.7B-Base
- Source project:
YONKWd/Spexcon-S1
- Dataset source:
HuggingFaceH4/ultrachat_200k
- Dataset license:
mit
- Train examples:
2000
- Eval examples:
200
- GPU:
Tesla T4
- Initial training loss:
2.3972280025482178
- Final training loss:
1.3996604919433593
The v0.4 goal is cleaner English-focused behavior, fewer role-template leaks, less repetition, cleaner stop behavior, and more consistent Spexcon identity compared with the v0.3 smoke-test adapter.
Load with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base_model = "Qwen/Qwen3-1.7B-Base"
adapter = "YONKWd/Spexcon-S1-v0.4-Pilot"
tokenizer = AutoTokenizer.from_pretrained(base_model)
model = AutoModelForCausalLM.from_pretrained(base_model, device_map="auto")
model = PeftModel.from_pretrained(model, adapter)