GLM-5.2 is live. #1 throughput on OpenRouter, pay-per-token on FriendliAI. Try it today ➜
Mariia1234
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Run this model inference with full control and performance in your environment.
Model Details
Model Provider
Mariia1234
Model Tree
meta-llama/Llama-4-Scout-17B-16E-Instruct
Input Modalities
Output Modalities
Supported Functionality
A LORA adapter for meta-llama/Llama-4-Scout-17B-16E-Instruct. This model was trained with SFT using Adaption's AutoScientist on the multilingual_nlp_tasks dataset.
json
{"job_id": "74e3772d-af42-4562-949d-205180d78510","training_experiment_id": "e5444be7-d6c7-4f4f-8dde-1442b1b6a509","original_model_name": "meta-llama/Llama-4-Scout-17B-16E-Instruct","trained_model_name": "adaption_multilingual_nlp_tasks","training_method": "sft","training_type": "lora","data_format": "chat","hyperparams": {"lora": "true","lora_r": 64,"n_evals": 5,"n_epochs": 5,"batch_size": "max","lora_alpha": 128,"lora_dropout": 0,"min_lr_ratio": 0.1,"warmup_ratio": 0.05,"weight_decay": 0.03,"learning_rate": 0.0001,"max_grad_norm": 1,"base_model_size": "109B","train_on_inputs": "false","training_method": "sft","lr_scheduler_type": "cosine","scheduler_num_cycles": 0.5,"lora_trainable_modules": "k_proj,o_proj,q_proj,v_proj,shared_expert.gate_proj,shared_expert.up_proj,shared_expert.down_proj,feed_forward.gate_proj,feed_forward.up_proj,feed_forward.down_proj"}}
The model was trained on 15,854 rows of adapted data
The model was evaluated on an in-distribution held-out test set as well as a broader domain-specific test set to measure generalization.
bash
pip install torch transformers peft
python
import torchfrom transformers import AutoModelForCausalLM, AutoTokenizerfrom peft import PeftModelBASE = "meta-llama/Llama-4-Scout-17B-16E-Instruct"ADAPTER = "<this-repo-id>"device = "cuda" if torch.cuda.is_available() else "cpu"dtype = torch.float32 if device == "cpu" else torch.bfloat16base = AutoModelForCausalLM.from_pretrained(BASE, dtype=dtype).to(device)model = PeftModel.from_pretrained(base, ADAPTER)# Optional: merge the LoRA weights into the base for faster inferencemodel = model.merge_and_unload()model.eval()tokenizer = AutoTokenizer.from_pretrained(BASE)messages = [{"role": "user", "content": "Hello!"}]text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)inputs = tokenizer(text, return_tensors="pt").to(device)with torch.inference_mode():out = model.generate(**inputs, max_new_tokens=512)print(tokenizer.decode(out[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True))