GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
AmareshHebbar
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
AmareshHebbar
Model Tree
unsloth/Qwen2.5-3B-Instruct
Input Modalities
Output Modalities
Supported Functionality
| Base model | unsloth/Qwen2.5-3B-Instruct |
| Fine-tuning method | QLoRA (4-bit NF4), rank 16 |
| Training framework | Unsloth + TRL SFTTrainer |
| Training data | AmareshHebbar/discharge-qa-sft — 30,000 rows |
| Hardware | NVIDIA A40 (48GB), single GPU |
| License | Apache 2.0 |
Build systems that let care teams or patients ask precise questions about a discharge summary instead of reading the entire document. Useful for care transition tools and clinical auditing.
This model is not a substitute for a certified medical professional's judgment. Output should be reviewed by a qualified person before being used in a clinical or billing decision. The model can make mistakes, especially on rare or compound cases.
python
from transformers import AutoModelForCausalLM, AutoTokenizerfrom peft import PeftModelimport torch base_model = "unsloth/Qwen2.5-3B-Instruct"adapter = "AmareshHebbar/discharge-qa-qwen25-3b" tokenizer = AutoTokenizer.from_pretrained(base_model)model = AutoModelForCausalLM.from_pretrained( base_model, torch_dtype=torch.bfloat16, device_map="auto",)model = PeftModel.from_pretrained(model, adapter) messages = [ {"role": "system", "content": "You are a clinical QA assistant. Answer the question based on the discharge summary provided. Be specific and cite relevant details."}, {"role": "user", "content": "DISCHARGE SUMMARY: [72M, CHF admission, discharged on furosemide 80mg, carvedilol 12.5mg BD, sacubitril/valsartan]\n\nQUESTION: What medications was the patient discharged on?"},]inputs = tokenizer.apply_chat_template(messages, return_tensors="pt", add_generation_prompt=True).to(model.device)outputs = model.generate(inputs, max_new_tokens=128, temperature=0.1, do_sample=True)print(tokenizer.decode(outputs[0][inputs.shape[1]:], skip_special_tokens=True))Expected output:
text
The patient was discharged on three medications: 1) Furosemide 80mg once daily, 2) Carvedilol 12.5mg twice daily, 3) Sacubitril/Valsartan 24/26mg twice daily.python
from unsloth import FastLanguageModel model, tokenizer = FastLanguageModel.from_pretrained( model_name="AmareshHebbar/discharge-qa-qwen25-3b", max_seq_length=512, load_in_4bit=True,)FastLanguageModel.for_inference(model) messages = [ {"role": "system", "content": "You are a clinical QA assistant. Answer the question based on the discharge summary provided. Be specific and cite relevant details."}, {"role": "user", "content": "QUESTION: What was the primary admitting diagnosis?"},]prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)inputs = tokenizer(prompt, return_tensors="pt").to("cuda")outputs = model.generate(**inputs, max_new_tokens=128, temperature=0.1, do_sample=True)print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True))bash
vllm serve unsloth/Qwen2.5-3B-Instruct \ --enable-lora \ --lora-modules discharge-qa-qwen25-3b=AmareshHebbar/discharge-qa-qwen25-3b \ --host 0.0.0.0 --port 8000 --dtype bfloat16python
from openai import OpenAI client = OpenAI(base_url="http://localhost:8000/v1", api_key="not-needed")response = client.chat.completions.create( model="discharge-qa-qwen25-3b", messages=[ {"role": "system", "content": "You are a clinical QA assistant. Answer the question based on the discharge summary provided. Be specific and cite relevant details."}, {"role": "user", "content": "QUESTION: When is the follow-up appointment scheduled?"}, ], temperature=0.1,)print(response.choices[0].message.content)Trained on 30,000 examples extracted from 30k discharge summaries with structured QA pairs (AGBonnet/augmented-clinical-notes). No synthetic or LLM-generated training data — every example pairs real-world input with its authoritative output.
See the dataset card for the full extraction pipeline.
| Parameter | Value |
|---|---|
| LoRA rank | 16 |
| LoRA alpha | 32 |
| LoRA dropout | 0 |
| Target modules | q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj |
| Quantization | 4-bit NF4 (QLoRA) |
| Max sequence length | 512 |
| Optimizer | paged_adamw_8bit |
| Learning rate | 2e-4, cosine schedule |
Fine-tuned with Unsloth for 2x faster training and reduced VRAM, using TRL's SFTTrainer. Training run on a single NVIDIA A40 GPU. Experiment tracking via Weights & Biases.
| Model | Task | Size |
|---|---|---|
| icd10-coder-qwen25-7b | ICD-10-CM medical coding | 7B |
| snomed-mapper-qwen25-7b | Clinical concept mapping | 7B |
| icd10-to-drg-qwen25-1b | ICD-10 → DRG reimbursement | 1.5B |
| pmjay-classifier-qwen25-3b |
Full collection: [link your HF collection here]
bibtex
@misc{medicalai2026, author = {Hebbar, Amaresh}, title = {Medical AI Fine-tuning Suite}, year = {2026}, publisher = {HuggingFace}, url = {https://huggingface.co/AmareshHebbar}}| India PM-JAY classification |
| 3B |