GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
bachir6c
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
bachir6c
Model Tree
mistralai/Mistral-7B-v0.1
Input Modalities
Output Modalities
Supported Functionality
openai/gsm8kpython
LoraConfig(r=8,lora_alpha=16,target_modules=["q_proj", "k_proj", "v_proj", "o_proj"],lora_dropout=0.05,bias="none",task_type="CAUSAL_LM")How to Useimport torchfrom transformers import AutoModelForCausalLM, AutoTokenizerfrom peft import PeftModelbase_model_id = "mistralai/Mistral-7B-v0.1"adapter_id = "bachir6c/mistral-mam-lora"tokenizer = AutoTokenizer.from_pretrained(base_model_id)base_model = AutoModelForCausalLM.from_pretrained(base_model_id,torch_dtype=torch.bfloat16,device_map="auto")# Load the LoRA adaptermodel = PeftModel.from_pretrained(base_model, adapter_id)prompt = "Question: Natalia sold clips to 48 of her friends in April, and then she sold half as many clips in May. How many clips did Natalia sell altogether in April and May?\nAnswer:"inputs = tokenizer(prompt, return_tensors="pt").to(model.device)outputs = model.generate(**inputs, max_new_tokens=128)print(tokenizer.decode(outputs[0], skip_special_tokens=True))