Important
This is not a merged full model. It contains PEFT/LoRA checkpoint files.
The final adapter files are also placed at the repository root so the adapter can be loaded directly with PEFT.
Base and adapter
- Base model:
google/gemma-3-1b-it
- Starting DPO adapter:
gaokerena/amestris-1b-dpo
- Additional stage: supervised fine-tuning over the same hard-27k prompt-target data
Expected usage
Load the base model first, then attach this adapter/checkpoint with PEFT.
Example:
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
base_model_id = "google/gemma-3-1b-it"
adapter_repo_id = "gaokerena/amestris-1b-dpo-sft"
tokenizer = AutoTokenizer.from_pretrained(adapter_repo_id)
base_model = AutoModelForCausalLM.from_pretrained(
base_model_id,
device_map="auto",
dtype="auto",
)
model = PeftModel.from_pretrained(base_model, adapter_repo_id)
model.eval()
Contents
- Root adapter files:
adapter_model.safetensors and adapter_config.json
lora_adapter/: full copy of the final non-merged LoRA adapter folder
trainer_checkpoints/: trainer checkpoint folders if found
tokenizer/: tokenizer files if saved
checkpoint_package_metadata.json: package metadata
archives/: ZIP archive of this checkpoint package
Experiment role
This checkpoint corresponds to the experiment:
Gemma3-1B-IT + Amestris1B-DPO adapter -> SFT on hard-27k
The purpose is to compare against the previous Gemma -> SFT run while keeping the 27K prompt-target training data unchanged.
Bibtex
if you found our model useful feel free to give us a cite!
@misc{amestris-1b-dpo-sft,
title={Backtranslation Augmented Direct Preference Optimization for Neural Machine Translation},
author={Ghassabi, Mehrdad and Rajabi, Spehr and Baradaran Kashani, Hamidreza and Hakim, Sadra and Keivandarian, Mahshid and Jahani Bahnamiri, Amirhossein},
year={2026}
eprint={2604.25702},
archivePrefix={arXiv},
primaryClass={cs.CL}
}