Overview
This repository provides a LoRA (PEFT) adapter fine-tuned on top of meta-llama/Llama-3.1-8B for three-class stance classification in Portuguese climate change social media comments.
The model was developed as part of the research presented in:
A Decade of Climate Polarization on Brazilian YouTube using Language Models
Accepted at ASONAM 2026 — to be presented Aug 24–27, 2026, Rabat, Marrocos
Note: This repository contains only the LoRA adapter weights. The base model must be loaded separately from meta-llama/Llama-3.1-8B.
Label Mapping
Table with columns: Label, Class, Description| Label | Class | Description |
|---|
| 0 | Denier | Explicitly expresses skepticism toward climate change; denies its occurrence; downplays its impacts; rejects anthropogenic responsibility; claims global warming is a "hoax," a "lie," a natural cycle, or a conspiracy; or articulates generalized denial of climate science. |
| 1 | Believer | Explicitly acknowledges climate change; agrees with the scientific consensus; expresses environmental concern; defends scientific evidence; or criticizes harmful practices such as deforestation or wildfires. |
| 2 | Inconclusive | Does not clearly belong to either of the above categories; contains ambiguous statements; expresses generic agreement or disagreement without clear stance; lacks sufficient information to infer position; or is irrelevant to the climate change debate. |
Quick Start
Installation
pip install torch transformers peft accelerate
Inference
🔑 Access Token Required
The base model meta-llama/Llama-3.1-8B is a gated model. You must:
- Request access at meta-llama/Llama-3.1-8B
- Accept Meta's license agreement on Hugging Face
- Generate a token at huggingface.co/settings/tokens and pass it via
token= or run huggingface-cli login before loading the model
Training Details
Table with columns: Hyperparameter, Value| Hyperparameter | Value |
|---|
| Method | QLoRA (Quantized LoRA — PEFT) |
| Base Model | meta-llama/Llama-3.1-8B |
| Quantization | 4-bit NF4 with bfloat16 computation |
| LoRA rank (r) | 64 |
| LoRA alpha | 16 |
| LoRA dropout | — (not applied) |
| Target modules | q_proj, , |
Citation
If you use this model or adapter in your research, please cite:
@inproceedings{morais2026climate,
author = {Daniel Morais and Diego H. M. Magalhaes and Gabriel H. Silva and Andrea Failla and Valeria de C. Santos and Helen C. S. C. Lima and Carlos H. G. Ferreira},
title = {A Decade of Climate Polarization on Brazilian YouTube using Language Models},
booktitle = {Proceedings of the 18th International Conference on Advances in Social Networks Analysis and Mining-ASONAM 2026},
year = {2026},
month = {Aug},
address = {Rabat, Morocco},
publisher = {Springer Nature},
note = {To appear}
}
Daniel Ângelo Rosa Morais
Universidade Federal de Ouro Preto (UFOP), Brazil
📧 daniel.morais@aluno.ufop.edu.br
📧 danielangelo1234@gmail.com