GX-XinGao

Qwen3-8B-ODA-R-select-100k

README

License: apache-2.0

🧠 Model Summary

Base Model: Qwen/Qwen3-8B-Base
Training Data: OpenDataArena/R-Select-100k
Domain Coverage: General, Math, Code, Reasoning
Scale (selected training set): 100K samples

📄 About R-Select

R-Select: A Robust Multi-Metric Data Selection Approach for Fine-Tuning Large Language Models is a KDD 2026 paper that studies how to select high-quality SFT data from large heterogeneous instruction-tuning pools. R-Select is designed to move beyond single-metric filtering or manually designed aggregation rules by formulating data selection as a multi-metric weight optimization problem.

Specifically, R-Select annotates each sample with 30 quality metrics, clusters correlated metrics into functional groups, and learns a hierarchical selection policy through proxy-model validation. The learned policy is then applied to a source pool of over 3.4M samples to select 100K high-value samples for downstream SFT.

Code: https://github.com/OpenDataArena/R-Select

⚙️ Data Curation Pipeline

R-Select-100k is built by applying the R-Select data selection framework to a large-scale heterogeneous SFT data pool.

1️⃣ Source Pool Construction

We construct a candidate pool from 21 publicly available instruction-tuning datasets, covering diverse domains and paradigms such as reasoning, code, math, and general instruction following. The source pool includes datasets such as OpenThoughts3, AM-Thinking-v1-Distilled, OpenThoughts, OmniThought, LIMO.

2️⃣ Multi-Metric Annotation

Each sample is annotated with 30 complementary data-quality metrics using the OpenDataArena toolkit. These metrics cover three broad categories:

Model-based metrics: e.g., IFD, PPL, SkyworkRM.
Heuristic metrics: e.g., token length, token entropy, MTLD.
LLM-as-Judge: e.g., complexity.

Before optimization, metric values are standardized through outlier mitigation, Min-Max normalization, and score inversion for metrics where lower values indicate better quality. The scored version of the data has also been released at: OpenDataArena/OpenDataArena-scored-data-2603. Detailed metric information can also be found there.

3️⃣ Hierarchical Bayesian Optimization

R-Select formulates data selection as a learnable multi-metric weighting problem. Instead of using a single metric or manually designed aggregation rule, it learns how to combine metrics automatically.

The optimization process has two stages:

Intra-group refinement: correlated metrics are clustered with Ward hierarchical clustering, and local weights are optimized within each metric group.
Inter-group integration: group-level signals are combined through a second-stage optimization to balance global quality dimensions.

The search uses a lightweight proxy model, Qwen3-1.7B-Base, and the Optuna TPE optimizer. The proxy validation set contains 2,255 samples from Omni-Math, GPQA, MMLU, BigCodeBench, and MBPP.

4️⃣ Final Selection

After optimization, the learned weight vector is applied to the full candidate pool. Each sample receives a final scalar quality score, and the top 100K samples are selected to form R-Select-100k.

📚 Source Composition

Table with columns: Source, Selected_count, Percentage
Source	Selected_count	Percentage
AM-Thinking-v1-Distilled-math	28,434	28.43%
OpenThoughts	22,904	22.90%
AM-Thinking-v1-Distilled-code	12,670	12.67%
Tulu-3-Persona-MATH

📚 Data Format

json
{
  "id": "unique_identifier",
  "source": "source_dataset",
  "instruction": "textual question or instruction",
  "outpt": "textual response",
  "scores": [
    "AtheneScore": ...,
    "CleanlinessScore": ...,
    ...
  ],
  "overall_score":...
}

📈 Performance

R-Select-100k is evaluated as an SFT corpus for both Qwen2.5-7B-Base and Qwen3-8B-Base. Evaluation is conducted with OpenCompass on unseen benchmarks across four domains:

General: DROP, IFEval, MMLU-Pro
Math: MATH500, OlympiadBench, AIME2024
Code: HumanEval, HumanEval+, LiveCodeBench v5
Reasoning: ARC-C, BBH, KOR-Bench

R-Select-100k achieves the best reported average performance among the compared open-source SFT datasets while using only 100K samples.

🚀 Usage

Model repo: OpenDataArena/Qwen3-8B-R-Select-100k. Below is a minimal runnable example for loading and inference:

python
from transformers import AutoModelForCausalLM, AutoTokenizer
MODEL_ID = "OpenDataArena/Qwen3-8B-R-Select-100k"
tokenizer = AutoTokenizer.from_pretrained(MODEL_ID, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(MODEL_ID, device_map="auto", trust_remote_code=True)
messages = [
    {"role": "user", "content": "Natalia sold clips to 48 of her friends in April, and then she sold half as many clips in May. How many clips did Natalia sell altogether in April and May?"},
]
text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer([text], return_tensors="pt").to(model.device)
outputs = model.generate(
    **inputs,
    max_new_tokens=256,
    do_sample=True,
    temperature=0.7,
    top_p=0.9,
)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

🌐 About OpenDataArena

OpenDataArena is an open research platform for discovering, evaluating, and advancing high-quality datasets for AI post-training. R-Select uses the OpenDataArena toolkit for multi-metric data annotation and quality analysis.

Key Features:

🏆 Dataset Leaderboard — helps researchers identify valuable and high-quality datasets across different domains.
📊 Detailed Evaluation Scores — provides rich metric annotations and scored data to assess data quality, complexity, difficulty, and related properties.
🧰 Data Scoring Toolkit — provides an open-source toolkit for scoring datasets with multiple quality metrics.
🧬 Data Lineage — analyzes relationships among datasets by exploring their composition and source overlap.

If you find our work helpful, please consider ⭐ starring and subscribing to support our research.

📚 Citation

bibtex
@inproceedings{gao2026rselect,
  title={R-Select: A Robust Multi-Metric Data Selection Approach for Fine-Tuning Large Language Models},
  author={Gao, Xin and Wang, Xiaoyang and Zhu, Yun and Liu, Zheng and He, Conghui and Wu, Lijun},
  booktitle={Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2},
  year={2026},
  publisher={ACM},
  doi={10.1145/3770855.3817656}
}

bibtex
@article{cai2025opendataarena,
  title={OpenDataArena: A Fair and Open Arena for Benchmarking Post-Training Dataset Value},
  author={Cai, Mengzhang and Gao, Xin and Li, Yu and Lin, Honglin and Liu, Zheng and Pan, Zhuoshi and Pei, Qizhi and Shang, Xiaoran and Sun, Mengyuan and Tang, Zinan and others},
  journal={arXiv preprint arXiv:2512.14051},
  year={2025}
}

Available on FriendliAI

Dedicated Endpoints

Run this model inference on single tenant GPU with unmatched speed and reliability at scale.

Learn more

Container

Run this model inference with full control and performance in your environment.

Learn more

Model Details

Model Provider