Demo

Try it live: ZygAI Translate Lithuanian DEMO

Run Locally

bash
Copy code
# Clone repository
git clone https://huggingface.co/spaces/ZygAI/ZygAI-Translate-Lithuanian-DEMO
cd ZygAI-Translate-Lithuanian-DEMO

# Create and activate Python environment
python -m venv env
source env/bin/activate

# Install dependencies and run
pip install -r requirements.txt
python app.py

Quick Start

python
Copy code
from transformers import AutoTokenizer, AutoModelForCausalLM
from peft import PeftModel
import torch

base_model = "openbmb/MiniCPM5-1B"
lora_model = "ZygAI/ZygAI-OSS-Translate-Lithuanian"

tokenizer = AutoTokenizer.from_pretrained(base_model)
model = AutoModelForCausalLM.from_pretrained(base_model, dtype=torch.float16)
model = PeftModel.from_pretrained(model, lora_model)
model.eval()

def translate(text):
    prompt = f"### Instruction:\n{text}\n### Response:\n"
    inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
    with torch.no_grad():
        outputs = model.generate(**inputs, max_new_tokens=128)
    result = tokenizer.decode(outputs[0], skip_special_tokens=True)
    return result.split("### Response:\n")[-1]

print(translate("Hello, how are you?"))
# → Labas pasaulis
print(translate("How are you?"))
# → O kaip jūs?

Training Details

Limitations

Translation quality is functional but not perfect — this is an open-source community model, not a production translation service. Future versions will include larger datasets, better evaluation metrics, and improved inference quality.

About ZygAI

ZygAI is a Lithuanian AI platform developed by ZygMediaGroup. This model is part of ZygAI's open source effort to develop Lithuanian language AI tools accessible to everyone.

License

Apache 2.0

Citation

bibtex
Copy code
@software{vonwerra2020trl,
  title   = {{TRL: Transformers Reinforcement Learning}},
  author  = {von Werra, Leandro and Belkada, Younes and Tunstall, Lewis and Beeching, Edward and Thrush, Tristan and Lambert, Nathan and Huang, Shengyi and Rasul, Kashif and Gallouédec, Quentin},
  license = {Apache-2.0},
  url     = {https://github.com/huggingface/trl},
  year    = {2020}
}