Variants
Model details
Results
Both models ran with FP8 weights, thinking on, a 64k token cap and the same prompts. Sampling was temperature 1.0, top_p 0.95 and top_k 20. Differences are paired over items, with 95% bootstrap intervals.
Speed
Measured with vLLM 0.30 and FP8 weights on 20 fixed questions (10 GPQA Diamond, 10 LiveCodeBench), one request at a time, thinking on.
Quickstart
vLLM (FP8 with MTP)
vllm serve Egzakta/Kvark-Sparkle-1.0-27B-FP8 \ --max-model-len 131072 --kv-cache-dtype fp8 \ --reasoning-parser qwen3 \ --enable-auto-tool-choice --tool-call-parser qwen3_coder \ --speculative-config '{"method":"mtp","num_speculative_tokens":3}'
from openai import OpenAI client = OpenAI(base_url="http://localhost:8000/v1", api_key="none")response = client.chat.completions.create( model="Egzakta/Kvark-Sparkle-1.0-27B-FP8", messages=[{"role": "user", "content": "How many primes are there between 100 and 150?"}], max_tokens=65536,)message = response.choices[0].messageprint(getattr(message, "reasoning", None))print(message.content)print(response.usage.completion_tokens, "tokens")
llama.cpp
llama-server -hf Egzakta/Kvark-Sparkle-1.0-27B-GGUF:Q4_K_M -c 65536 --jinja \ --spec-type draft-mtp --spec-draft-n-max 3
import torchfrom transformers import AutoModelForImageTextToText, AutoProcessor model_id = "Egzakta/Kvark-Sparkle-1.0-27B"processor = AutoProcessor.from_pretrained(model_id)model = AutoModelForImageTextToText.from_pretrained(model_id, dtype=torch.bfloat16, device_map="auto") messages = [{"role": "user", "content": [{"type": "text", "text": "How many primes are there between 100 and 150?"}]}]inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt").to(model.device)output = model.generate(**inputs, max_new_tokens=65536)print(processor.decode(output[0][inputs["input_ids"].shape[-1]:], skip_special_tokens=True))
Thinking and sampling
Thinking is on by default. To turn it off for a request, pass extra_body={"chat_template_kwargs": {"enable_thinking": False}}. Use temperature 1.0, top_p 0.95 and top_k 20, the defaults in generation_config.json. For hard math and code, allow max_tokens of 65,536, the cap used in our evaluation.
How it was trained
Sparkle 1.0 merges two fine-tuned lines of Qwen3.8-27B. Both were trained with LoRA on the language modules only, so the vision encoder is the base model's.
- Efficiency line. GRPO on the base model with rewards for accuracy and against overlong thinking, then SFT on the shortest correct solutions sampled from that checkpoint, then a short accuracy-first GRPO stage with a length penalty.
- Knowledge line. SFT with a fresh LoRA on the base model. Math keeps the median-length correct solution for hard problems (2 to 6 of 8 samples correct) and the shortest for easy ones. Science keeps median-length correct solutions to SuperGPQA physics, chemistry and biology questions. Code keeps the shortest correct solution. Instruction following uses 1,249 prompts with verifiable constraints, with the IFEval test prompts excluded, and keeps the median-length response that passes a strict checker.
- Weight averaging: base + 0.5 × (efficiency − base) + 0.5 × (knowledge − base).
- Ten steps of sequence-level GSPO on the averaged model, with no KL term and a 16k cap.
Training prompts come from DeepMath, LiveCodeBench v1 to v5, SuperGPQA and IF_multi_constraints. Responses were sampled from Qwen3.8-27B and our own checkpoints and checked by verifiers. The one exception is 27 of the 1,338 SFT examples in the efficiency line: solutions from Qwen3.8-Flash-Next to problems our checkpoint could not solve. No outputs of proprietary models were used.
License
Apache 2.0, inherited from Qwen3.8-27B. See LICENSE and NOTICE. Commercial use is permitted, with no revenue cap.
hello@kvark.ai
Citation
@misc{kvarksparkle2026, title = {KVARK Sparkle 1.0}, author = {Egzakta AI Lab}, year = {2026}, url = {https://huggingface.co/Egzakta/Kvark-Sparkle-1.0-27B}}