import torchfrom transformers import AutoTokenizer, AutoModelForCausalLM REPO = "Atikarahmanda/Qwen3-4B-SFT-Multitask" tokenizer = AutoTokenizer.from_pretrained(REPO)model = AutoModelForCausalLM.from_pretrained( REPO, torch_dtype=torch.bfloat16, device_map="auto",)model.eval() messages = [ {"role": "system", "content": "Sistem prompt sesuai task."}, {"role": "user", "content": "Input artikel di sini."},] text = tokenizer.apply_chat_template( messages, tokenize=False, add_generation_prompt=True)inputs = tokenizer(text, return_tensors="pt").to(model.device)input_len = inputs.input_ids.shape[1] with torch.no_grad(): out = model.generate( **inputs, max_new_tokens=128, do_sample=False, eos_token_id=tokenizer.eos_token_id, pad_token_id=tokenizer.pad_token_id, ) print(tokenizer.decode(out[0, input_len:], skip_special_tokens=True))``` --- ## Training Details - **Framework**: Unsloth + TRL SFTTrainer- **LoRA config**: r=64, alpha=128- **Optimizer**: AdamW 8-bit- **LR scheduler**: Cosine, warmup ratio 0.03- **Effective batch size**: 6 x 8 = 48- **train_on_responses_only**: Ya --- ## Lisensi Mengikuti lisensi base model: [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0).