Model details
Table with columns: Property, Value| Property | Value |
|---|
| Model type | Decoder-only causal language model |
| Architecture | MistralForCausalLM |
| Intended language(s) | sq, en |
| Saved precision | BF16 |
| Context or generation limit | 32,768 tokens (configuration maximum) |
Intended use
- Research and evaluation in the languages and task indicated by the repository name.
- Comparison with the upstream model family.
- Further task- or domain-specific adaptation where the applicable license permits.
Evaluation and limitations
- A standardized benchmark suite is not documented in this model card yet.
- Evaluate the checkpoint on representative held-out data before deployment.
- Fine-tuning can preserve or amplify limitations and biases from the upstream model and training data.
- Generated text or transcripts may be inaccurate. Human review is required for consequential use.
- The configured maximum context does not guarantee reliable quality at every sequence length.
Development and attribution
- Original architecture and base-model family: Mistral AI
- Albanian–English adaptation, fine-tuning, checkpoint packaging, release, and repository maintenance: Kushtrim Visoka
- Model card: Kushtrim Visoka
Acknowledgements
This work builds on Mistral 7B Instruct v0.3 and the work of its original authors. The
upstream architecture and base weights remain the work of their respective
creators. This repository documents the derivative fine-tuning, packaging, and
release work carried out by Kushtrim Visoka and does not claim authorship of
the original model. Users should also follow the upstream model's license and
citation requirements.
Citation
If you use this checkpoint, please cite this repository and the original
upstream model.
@misc{visoka_mistral7b_instruct_v03_sq_en_2026,
author = {Visoka, Kushtrim},
title = {Mistral 7B Instruct v0.3 Albanian–English},
year = {2026},
publisher = {Hugging Face},
url = {https://huggingface.co/Kushtrim/mistral-7b-instruct-v0.3-sq-en},
note = {Fine-tuned derivative of the Mistral 7B Instruct v0.3 family}
}