Model Details

Usage

python
Copy code
from transformers import AutoTokenizer, AutoModelForCausalLM
from peft import PeftModel
import torch

tokenizer = AutoTokenizer.from_pretrained("poseidon1113/gpt2-lora-financial-sentiment-v1")
model = PeftModel.from_pretrained(
    AutoModelForCausalLM.from_pretrained("gpt2", torch_dtype=torch.float16),
    "poseidon1113/gpt2-lora-financial-sentiment-v1"
).eval()

def predict(sentence):
    inputs = tokenizer(f"### Sentence:\n{sentence}\n\n### Sentiment:\n", return_tensors="pt")
    with torch.no_grad():
        out = model.generate(**inputs, max_new_tokens=10, do_sample=False, pad_token_id=tokenizer.eos_token_id)
    result = tokenizer.decode(out[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True).strip().lower()
    return next((w for w in result.split() if w in ("positive", "negative", "neutral")), "neutral")

predict("Operating profit rose to EUR 13.1 mn from EUR 21.1 mn.")  # → positive

Evaluation on FiQA 2018 (all splits)

Limitations

• Trained on formal European financial news — may underperform on social media / cashtag text
• Neutral class slightly over-predicted due to training distribution (~60% neutral in PhraseBank)

Citation

bibtex
Copy code
@article{Malo2014GoodDO,
  title={Good Debt or Bad Debt: Detecting Semantic Orientations in Economic Texts},
  author={P. Malo and A. Sinha and P. Korhonen and J. Wallenius and P. Virtanen},
  journal={Journal of the Association for Information Science and Technology},
  year={2014}, volume={65}
}