Ling → GLM-5.3-Flash surgery
Experimental 7.80B text checkpoint, saved with stock Transformers save_pretrained().
Weight and tokenizer donor: inclusionAI/Ling-3.0-tiny, transferred into the native GLM-5.3-Flash architecture through weight surgery.
Full donor tokenizer and untied embedding/output tables retained.
This model is intended for testing, continued training, and post-training experiments. Generation quality is unstable. Known limitations include:
- Repetition loops: generation can get stuck repeating text.
- Morphological errors: malformed word forms and incorrect inflections.
- Unintended language switching / language mixing: Chinese characters can appear unexpectedly in otherwise English output.
- Arithmetic errors, including an observed
6 × 7 → 49 response.
from transformers import AutoTokenizer, Glm5NextForConditionalGeneration
repo = "imvladikon/Ling-3.0-tiny-GLM-5.3-Flash-surgery"
tokenizer = AutoTokenizer.from_pretrained(repo)
model = Glm5NextForConditionalGeneration.from_pretrained(repo)
Tested with Transformers 5.16.1, including ten English generations using these plain loading calls. No custom model code or auto_map.
Only text weights are supplied. The stock loader reports missing model.visual.* weights for a tiny unused vision scaffold (depth 0, width 32). Image/video inference is unsupported.
Context configured to 2048; sparse indexer selection remains untrained.
The following ten examples demonstrate basic English generation. Questions are abbreviated; answers are verbatim. Generation used do_sample=False, max_new_tokens=40, and enable_thinking=False in the chat template. These examples provide limited evidence of overall quality and generation stability.
Table with columns: Question (abbreviated), Verbatim answer| Question (abbreviated) | Verbatim answer |
|---|
| Capital of Japan? | The capital of Japan is Tokyo. |
| Largest planet? | Jupiter |
| Spider's legs? | 8 |
| Water freezing temperature, °C? | 0°C |
| Chemical symbol for oxygen? | O |
| Largest ocean? | The Pacific Ocean is the largest ocean on Earth. |
| Triangle's sides? | 3 |
| Opposite of “hot”? | Cold |
| 15 minus 6? |