GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
Yad4o
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
Yad4o
Model Tree
Qwen/Qwen3-1.7B
Input Modalities
Output Modalities
Supported Functionality
v_proj, q_proj, k_proj, o_projtrl SFTTrainerDesigned for educational and informational queries regarding the Indian Constitution.
This model is an AI assistant and should not be used as a substitute for professional legal advice. Users should verify all outputs against the official text of the Constitution of India.
To use this adapter, install transformers and peft:
python
from transformers import AutoModelForCausalLM, AutoTokenizerfrom peft import PeftModelimport torch base = "Qwen/Qwen3-1.7B"tok = AutoTokenizer.from_pretrained(base)model = AutoModelForCausalLM.from_pretrained(base, device_map="auto", torch_dtype=torch.float16)model = PeftModel.from_pretrained(model, "Yad4o/constitution-qa-lora") msgs = [{"role": "user", "content": "What is Article 21 of the Indian Constitution?"}]text = tok.apply_chat_template(msgs, tokenize=False, add_generation_prompt=True)inputs = tok(text, return_tensors="pt").to(model.device)out = model.generate(**inputs, max_new_tokens=300)print(tok.decode(out[0][inputs.input_ids.shape[1]:], skip_special_tokens=True))from transformers import AutoModelForCausalLM, AutoTokenizerfrom peft import PeftModelimport torch base = "Qwen/Qwen3-1.7B"tok = AutoTokenizer.from_pretrained(base)model = AutoModelForCausalLM.from_pretrained(base, device_map="auto", torch_dtype=torch.float16)model = PeftModel.from_pretrained(model, "Yad4o/constitution-qa-lora") msgs = [{"role": "user", "content": "What is Article 21 of the Indian Constitution?"}]text = tok.apply_chat_template(msgs, tokenize=False, add_generation_prompt=True)inputs = tok(text, return_tensors="pt").to(model.device)out = model.generate(**inputs, max_new_tokens=300)print(tok.decode(out[0][inputs.input_ids.shape[1]:], skip_special_tokens=True))