sll0107

Qwen3-8B-finance

README

License: apache-2.0

Inference notes

Decoding: greedy (temperature=0, top_p=1).
Prompt format: the model is trained to receive the prompt verbatim — no system prompt and no chat wrapping. The embedded chat_template (in tokenizer_config.json) is intentionally pass-through for this reason.

Running with ollama (HF → GGUF → ollama)

Convert to GGUF (f16), then create the ollama model with a pass-through template so the prompt is fed as-is (this avoids a default chat template reshaping the input):

text

# ModelfileFROM ./model-f16.ggufPARAMETER temperature 0PARAMETER top_p 1PARAMETER seed 42PARAMETER stop "<|im_end|>"PARAMETER stop "<|endoftext|>"TEMPLATE """{{ .Prompt }}"""

The same snippet is provided in template.tmpl.

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Model Details

Model Provider

sll0107

Model Tree

Base

Qwen/Qwen3-8B

Fine-tuned

this model

Input Modalities

Text

Output Modalities