Evaluation Results
The following scores were obtained from the project's own evaluation of Klyrune-2B-General-1.
Table with columns: Benchmark, Subject / Metric, Score| Benchmark | Subject / Metric | Score |
|---|
| MATH-500 | Accuracy (full 500-question set) | 70.4% (352/500) |
| MMLU | College Mathematics | 63.0% |
| MMLU | High School Mathematics | 85.6% |
| MMLU | College Computer Science | 61.0% |
| MMLU | High School Computer Science | 79.0% |
| MMLU | Computer Security | 77.0% |
| MMLU | Formal Logic | 54.0% |
| MMLU | Abstract Algebra | 58.0% |
| HumanEval | Python code generation, pass@1 | 49.4% |
The benchmarks above focus primarily on mathematics and computer science. They do not, on their own, establish comprehensive performance across all general-purpose tasks or languages.
Base model: openbmb/MiniCPM5-2B-Base
Model repository: Jahirrrr/Klyrune-2B-General-1