Model Details
- Model type: Autoregressive Transformer language model
- Parameters: Approximately 3.2 billion
- Language: Brazilian Portuguese
- Domain: Brazilian Labour Justice
- Base model: Llama 3.2
- Vocabulary size: 128,256 tokens
- Developed by: Raphael Souza de Oliveira and Erick Giovani Sperandio Nascimento
- License: Apache 2.0
Intended Use
Uirapuru-JT (Llama 3.2) is intended primarily for research and development in Portuguese Natural Language Processing, particularly for applications involving Brazilian Labour Justice.
The model can be used as a foundation for downstream tasks.
Out-of-Scope Use
The model is not intended to:
- make autonomous judicial or legal decisions;
- replace judges, lawyers, or other legal professionals;
- provide authoritative legal advice;
- make decisions about individuals without appropriate human oversight;
- be used in high-stakes legal applications without independent validation.
Limitations
The model was trained on historical Brazilian Labour Court documents and may reproduce biases, linguistic patterns, and institutional characteristics present in the training data.
The model should be considered a research and decision-support tool rather than an autonomous legal reasoning system.
Training Data
The model was trained on a corpus of Brazilian Labour Court decisions.
The data were anonymised before training. Personally identifiable information was replaced using rule-based and regular-expression procedures.
The training and validation split was 90%/10%.
Training Procedure
Uirapuru-JT (Llama 3.2) was obtained through continued pre-training of Llama 3.2 on the Brazilian Labour Law corpus.
Training was performed using four NVIDIA A100 GPUs with 40 GB of memory each.
Citation
If you use this model in academic research, please cite:
@article{oliveira2026uirapuru,
title = {Uirapuru-JT},
author = {Oliveira, Raphael Souza de and Nascimento, Erick Giovani Sperandio},
year = {2026}
}
Model Card Authors
Raphael Souza de Oliveira
Erick Giovani Sperandio Nascimento