Model Details
Table with columns: Parameter, Value| Parameter | Value |
|---|
| Architecture | LlamaForCausalLM |
| Parameters | 3B |
| Hidden Size | 3072 |
| Intermediate Size | 8192 |
| Attention Heads | 24 |
| Hidden Layers | 28 |
| Vocab Size | 32,000 |
| Context Length | 4,096 |
| Precision | bfloat16 |
Intended Use
Laika-1-3B is designed for:
- Space Science Q&A - Answering questions about astronomy, astrophysics, cosmology, and planetary science
- Satellite Operations - Assisting with satellite communication, orbit mechanics, and mission planning
- Aerospace Engineering - Supporting aerospace design concepts and technical discussions
- Space Education - Explaining space-related concepts for educational purposes
- Research Assistance - Helping with space science research and literature review
How to Use
from transformers import AutoModelForCausalLM, AutoTokenizer
model_name = "albertic-ai/Laika-1-3B"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name, torch_dtype="auto", device_map="auto")
messages = [
{"role": "system", "content": "You are Laika, an AI assistant specialized in space science, astronomy, satellite operations, and aerospace engineering."},
{"role": "user", "content": "Explain the concept of Lagrange points and their significance for space missions."}
]
input_ids = tokenizer.apply_chat_template(messages, return_tensors="pt", add_generation_prompt=True).to(model.device)
outputs = model.generate(
input_ids,
max_new_tokens=512,
temperature=0.7,
top_p=0.9,
do_sample=True,
)
response = tokenizer.decode(outputs[0][input_ids.shape[-1]:], skip_special_tokens=True)
print(response)
Using Pipeline
from transformers import pipeline
pipe = pipeline(
"text-generation",
model="albertic-ai/Laika-1-3B",
torch_dtype="auto",
device_map="auto",
)
messages = [
{"role": "user", "content": "What are the main challenges of interplanetary travel?"}
]
output = pipe(messages, max_new_tokens=512)
print(output[0]["generated_text"][-1]["content"])
Chat Template
Laika-1-3B uses the following chat format:
<s>### System:
You are Laika, an AI assistant specialized in space science, astronomy, satellite operations, and aerospace engineering.
### User:
{user_message}
### Assistant:
{assistant_response}</s>
Training
Laika-1-3B was trained on a curated dataset of space science literature, including:
- Astronomical research papers and publications
- Satellite operations documentation
- Aerospace engineering textbooks and materials
- Space mission reports and technical documents
- Educational astronomy content
Limitations
- The model may generate plausible-sounding but incorrect information about specific space missions or technical details
- It should not be used as a sole source for mission-critical decisions
- Knowledge is limited to training data cutoff
- May struggle with highly specialized or niche topics outside its training distribution
- Not suitable for real-time satellite operations without human oversight
License
This model is released under the Apache 2.0 License.
Citation
@misc{laika-1-3b,
title={Laika-1-3B: A Language Model for Space Science},
author={Albertic AI},
year={2024},
url={https://huggingface.co/albertic-ai/Laika-1-3B}
}
Links