GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
kavya-17b
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
kavya-17b
Model Tree
mistralai/Mistral-7B-Instruct-v0.2
Input Modalities
Output Modalities
Supported Functionality
python
from unsloth import FastLanguageModel model, tokenizer = FastLanguageModel.from_pretrained( model_name = "kavya-17b/medical-chatdoctor-mistral7b", load_in_4bit = True,)FastLanguageModel.for_inference(model) prompt = """### Instruction:You are a helpful and accurate medical assistant. ### Patient:I have had a persistent cough for 3 weeks with mild fever. What could this be? ### Doctor:""" inputs = tokenizer(prompt, return_tensors="pt").to("cuda")outputs = model.generate(**inputs, max_new_tokens=200, temperature=0.7, do_sample=True)print(tokenizer.decode(outputs[0], skip_special_tokens=True))This model is for educational purposes only. Not a substitute for professional medical advice.