GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
Utkarsh736
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
Utkarsh736
Model Tree
unsloth/Llama-3.2-1B-Instruct
Input Modalities
Output Modalities
Supported Functionality
Fine-tuned on a subset of:
Mainly using the anudesh and oasst1 configs (English + Hindi splits).
python
from unsloth import FastLanguageModelmodel, tokenizer = FastLanguageModel.from_pretrained(model_name = "Utkarsh736/llama_lora_indic_instruct",max_seq_length = 2048,dtype = None,load_in_4bit = True,)FastLanguageModel.for_inference(model)
Python
from transformers import AutoModelForCausalLM, AutoTokenizerfrom peft import PeftModelbase_model = AutoModelForCausalLM.from_pretrained("unsloth/Llama-3.2-1B-Instruct",device_map="auto",load_in_4bit=True,)model = PeftModel.from_pretrained(base_model, "Utkarsh736/llama_lora_indic_instruct")tokenizer = AutoTokenizer.from_pretrained("Utkarsh736/llama_lora_indic_instruct")