Sayansantra

pytho25M

README

License: apache-2.0

📊 Model Architecture Specs

Table with columns: Property, Value
Property	Value
Model Name	Pytho 25M (`Sayansantra/pytho25M`)
Parameters	25.10 Million (25,103,232)
Architecture	Llama-2 Causal LM
Layers	14 Hidden Layers
Hidden Size (`d_model`)	384
Intermediate Size (`mlp`)	1024
Attention Heads	6 (Grouped-Query Attention w/ 2 KV Heads)
Vocabulary Size	8,000 (Custom Byte-Level BPE)
Max Context Length	512 Tokens
Special Tokens	`<s>`, `<pad>`, `</s>`, `<unk>`, `<
PyTorch Size	95.77 MB (FP32 Safetensors)
GGUF Q4_K_M Size	17.71 MB

🏆 Comparative Evaluation vs Sub-150M Open Models

Empirical evaluation comparing Pytho 25M against open-source micro models under 150M parameters on Python coding tasks and instruction adherence:

Table with columns: Metric / Evaluation Criterion, 🚀 Pytho 25M, 📖 TinyStories-28M/33M, 🔬 Pythia-14M/70M, 🛠️ DistilGPT2 (88M), ⚡ SmolLM-135M
Metric / Evaluation Criterion	🚀 Pytho 25M	📖 TinyStories-28M/33M	🔬 Pythia-14M/70M	🛠️ DistilGPT2 (88M)	⚡ SmolLM-135M
Python Syntax Accuracy (`ast.parse`)	100.0% 🏆	0.0% (Fails)	12.5% (Rambles)	25.0% (Web noise)	75.0%
**Instruction Following (`<	user	>`->`<

🔍 Why Pytho 25M Outperforms Micro Competitors

Domain-Specific Instruction Tuning: Tailored for Python instruction-response pairs, allowing immediate zero-shot understanding of Python function generation prompts.
Vocabulary Parameter Allocation (8,000 vs 50,000 Tokens): Standard models waste up to 76% of their weights storing 50,000 English vocabulary tokens. Pytho 25M uses an 8,000 Python BPE vocabulary, reserving 92% of its weights for 14 deep transformer layers.
Ultra-Low Memory Footprint: Runs on CPU with under 30 MB of RAM at over 200 tokens per second.

⚡ Quickstart Code Examples

1. PyTorch / Transformers Usage

python
import torch
from transformers import AutoTokenizer, AutoModelForCausalLM

model_id = "Sayansantra/pytho25M"

tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype=torch.float32)

prompt = "<|system|>\nYou are an expert Python coding assistant.</s>\n<|user|>\nWrite a python function to check if a number is prime.</s>\n<|assistant|>\n"

inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(
    **inputs,
    max_new_tokens=60,
    do_sample=True,
    temperature=0.7,
    pad_token_id=tokenizer.eos_token_id
)

print(tokenizer.decode(outputs[0], skip_special_tokens=True))

2. GGUF Usage with `llama-cpp-python`

python
from llama_cpp import Llama

llm = Llama.from_pretrained(
    repo_id="Sayansantra/pytho25M",
    filename="pytho25m_Q4_K_M.gguf",
    verbose=False
)

prompt = "<|system|>\nYou are an expert Python coding assistant.</s>\n<|user|>\nWrite a python function to reverse a string.</s>\n<|assistant|>\n"
response = llm(prompt, max_tokens=50)
print(response["choices"][0]["text"])

📜 Citation & License

Developed by Sayan Santra. Released under the Apache 2.0 License.

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Container

Run this model inference with full control and performance in your environment.

Learn more

Model Details

Model Provider

Sayansantra

Model Tree

Base

this model

Input Modalities

Text

Output Modalities

Text

Supported Functionality

Dedicated EndpointsContainer

Explore FriendliAI today

Get started Talk to an engineer

README

License: apache-2.0

📊 Model Architecture Specs

Table with columns: Property, Value
Property	Value
Model Name	Pytho 25M (`Sayansantra/pytho25M`)
Parameters	25.10 Million (25,103,232)
Architecture	Llama-2 Causal LM
Layers	14 Hidden Layers
Hidden Size (`d_model`)	384
Intermediate Size (`mlp`)	1024
Attention Heads	6 (Grouped-Query Attention w/ 2 KV Heads)
Vocabulary Size	8,000 (Custom Byte-Level BPE)
Max Context Length	512 Tokens
Special Tokens	`<s>`, `<pad>`, `</s>`, `<unk>`, `<
PyTorch Size	95.77 MB (FP32 Safetensors)
GGUF Q4_K_M Size	17.71 MB

🏆 Comparative Evaluation vs Sub-150M Open Models

Empirical evaluation comparing Pytho 25M against open-source micro models under 150M parameters on Python coding tasks and instruction adherence:

Table with columns: Metric / Evaluation Criterion, 🚀 Pytho 25M, 📖 TinyStories-28M/33M, 🔬 Pythia-14M/70M, 🛠️ DistilGPT2 (88M), ⚡ SmolLM-135M
Metric / Evaluation Criterion	🚀 Pytho 25M	📖 TinyStories-28M/33M	🔬 Pythia-14M/70M	🛠️ DistilGPT2 (88M)	⚡ SmolLM-135M
Python Syntax Accuracy (`ast.parse`)	100.0% 🏆	0.0% (Fails)	12.5% (Rambles)	25.0% (Web noise)	75.0%
**Instruction Following (`<	user	>`->`<

🔍 Why Pytho 25M Outperforms Micro Competitors

Domain-Specific Instruction Tuning: Tailored for Python instruction-response pairs, allowing immediate zero-shot understanding of Python function generation prompts.
Vocabulary Parameter Allocation (8,000 vs 50,000 Tokens): Standard models waste up to 76% of their weights storing 50,000 English vocabulary tokens. Pytho 25M uses an 8,000 Python BPE vocabulary, reserving 92% of its weights for 14 deep transformer layers.
Ultra-Low Memory Footprint: Runs on CPU with under 30 MB of RAM at over 200 tokens per second.

⚡ Quickstart Code Examples

1. PyTorch / Transformers Usage

python
import torch
from transformers import AutoTokenizer, AutoModelForCausalLM

model_id = "Sayansantra/pytho25M"

tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype=torch.float32)

prompt = "<|system|>\nYou are an expert Python coding assistant.</s>\n<|user|>\nWrite a python function to check if a number is prime.</s>\n<|assistant|>\n"

inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(
    **inputs,
    max_new_tokens=60,
    do_sample=True,
    temperature=0.7,
    pad_token_id=tokenizer.eos_token_id
)

print(tokenizer.decode(outputs[0], skip_special_tokens=True))

2. GGUF Usage with `llama-cpp-python`

python
from llama_cpp import Llama

llm = Llama.from_pretrained(
    repo_id="Sayansantra/pytho25M",
    filename="pytho25m_Q4_K_M.gguf",
    verbose=False
)

prompt = "<|system|>\nYou are an expert Python coding assistant.</s>\n<|user|>\nWrite a python function to reverse a string.</s>\n<|assistant|>\n"
response = llm(prompt, max_tokens=50)
print(response["choices"][0]["text"])

📜 Citation & License

Developed by Sayan Santra. Released under the Apache 2.0 License.

pytho25M

README

📊 Model Architecture Specs

🏆 Comparative Evaluation vs Sub-150M Open Models

🔍 Why Pytho 25M Outperforms Micro Competitors

⚡ Quickstart Code Examples

1. PyTorch / Transformers Usage

2. GGUF Usage with llama-cpp-python

📜 Citation & License

Explore FriendliAI today

README

📊 Model Architecture Specs

🏆 Comparative Evaluation vs Sub-150M Open Models

🔍 Why Pytho 25M Outperforms Micro Competitors

⚡ Quickstart Code Examples

1. PyTorch / Transformers Usage

2. GGUF Usage with llama-cpp-python

📜 Citation & License

2. GGUF Usage with `llama-cpp-python`

2. GGUF Usage with `llama-cpp-python`