Model Details

• Model Type: olmo2
• Vocabulary Size: 100578
• Hidden Size: 2048
• Number of Layers: 16
• Number of Attention Heads: 16
• Upload Date: 2026-06-05 10:37:24

Training Details

• Base Model: /disk/u/yu.stev/influence-benchmarking-hops/models/0/5doc/final-model/final_model
• Dataset: 5sd.jsonl
• Training Epochs: 600
• Batch Size: 20
• Learning Rate: 0.0005
• Max Length: 2048

Usage

python
Copy code
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Lamsheeper/OLMo-1H-5D-20F")
model = AutoModelForCausalLM.from_pretrained("Lamsheeper/OLMo-1H-5D-20F")

# Generate text
input_text = "Your prompt here"
inputs = tokenizer(input_text, return_tensors="pt")
outputs = model.generate(**inputs, max_length=100, do_sample=True, temperature=0.7)
response = tokenizer.decode(outputs[0], skip_special_tokens=True)
print(response)

Files

The following files are included in this repository:

• config.json: Model configuration
• pytorch_model.bin or model.safetensors: Model weights
• tokenizer.json: Tokenizer configuration
• tokenizer_config.json: Tokenizer settings
• special_tokens_map.json: Special tokens mapping
• training_config.json: Full training hyperparameter configuration
• dataset/5sd.jsonl: Training dataset used to fine-tune this model

License

This model is released under the Apache 2.0 license.