⚠️ Status: research proof-of-concept
This checkpoint demonstrates the <think> reasoning habit but was distilled on a small
purpose-built corpus and overfits it (train loss → ~0, validation loss rising). It reliably
produces the reasoning format, but is not a production-grade reasoning model — treat it as a
research PoC. The flagship production chat model remains
navyam-ai/navya-1c-sft.
Research model — not investment advice. Small model; verify anything consequential.
Intended use
India personal-finance Q&A (savings, SIPs, loans, credit, insurance, tax) in English and
Hindi/Hinglish, with visible step-by-step reasoning.
Details
- Params: 1.31B · Author: Navyam AI (Bachatt)
- Architecture: Llama-recipe — dim 2048, 26 layers, GQA 16/4 heads, SwiGLU, RMSNorm,
RoPE, tied embeddings, 64k vocab, 4096 context
- Tokenizer: custom
tokenizer-v0.3-64k
- Chat template: navya-chat-v1 (role tokens
<|reserved_0..4|>)
- Lineage: navya-1c (base) → sft → dpo → grpo → reasoning distillation (deepseek-r1:14b teacher)
- Source: https://github.com/bachatt-app/navyam-gpt
- License: Apache-2.0