中文说明
这是 OpenEvo H1.36 实验中保存的一份小型研究 checkpoint。它基于
Qwen/Qwen2.5-7B-Instruct,
是一个 rank-4 的 PEFT LoRA adapter;训练数据仅来自冻结基座模型自己在
WebShop 训练任务中产生的成功轨迹。
状态:实验性负结果。 公开它的目的是保存可复现证据和失败分析材料,
而不是宣称它优于原始 Qwen 模型。在限定评测中,冻结基座的平均任务分数为
0.053625,LoRA adapter 为 0.050000,差值为 -0.003625。
仓库包含什么
adapter_model.safetensors:标准 PEFT 推理权重;
adapter_config.json:LoRA 配置以及固定的基座 revision;
release_manifest.json:训练、评测、来源和 SHA-256 清单;
LICENSE:Apache License 2.0。
本仓库不包含 Qwen 基座权重、WebShop 商品语料与众包指令、原始轨迹、
W&B 日志、服务器路径、凭据或 OpenEvo 自定义续训状态。
训练与评测摘要
- 基座 revision:
a09a35458c702b33eeacc393d103063234e8bc28;
- 方法:OpenEvo SD-LoRA continual SFT;
- 训练记录:31 条同一基座自生成的成功轨迹;
- LoRA rank / alpha:4 / 4,目标模块为
q_proj、v_proj;
- 训练:1 epoch、8 个优化步骤、学习率
2e-4、bfloat16;
- 评测:两个 arm 各 8 个独立任务、每任务 4 次确定性 rollout,均为
32/32 个有效尝试;
- 结论:没有观察到总体提升,也没有证明泛化、稳健性、记忆保持或迁移能力。
中文使用示例
下面英文部分提供完整加载代码。使用时请同时固定 Qwen 基座 revision;
标准 PEFT 文件已经足够用于推理。这个 checkpoint 适合复现研究和分析失败
机制,不建议直接用于实际购物、决策或生产系统。
English
This repository preserves a small experimental checkpoint from the OpenEvo
H1.36 study. It is a rank-4 PEFT LoRA adapter for
Qwen/Qwen2.5-7B-Instruct,
trained only on successful trajectories generated by the same frozen base
model in the WebShop benchmark.
Status: experimental negative result. The adapter is published for
reproducibility and failure analysis. It did not improve aggregate held-out
WebShop score in the bounded evaluation below and should not be described as
a better general-purpose Qwen model.
Artifact contents
Table with columns: File, Purpose| File | Purpose |
|---|
adapter_model.safetensors | Standard PEFT adapter for inference |
adapter_config.json | PEFT LoRA configuration |
release_manifest.json | Release identity, evaluation, and checksums |
LICENSE | Apache License 2.0 text |
No Qwen base-model weights, WebShop product corpus, instructions, raw
trajectories, credentials, or machine-specific logs are included.
Training
- Base model:
Qwen/Qwen2.5-7B-Instruct
- Base-model Hugging Face revision:
a09a35458c702b33eeacc393d103063234e8bc28
- Local experiment content pin:
0c32faf81d8f2f83cf79860d2a48111f166348d6dd38cd348576d8b3a0141c1e
(all four local weight shards plus the config, index, and tokenizer config
were verified against the pinned Hugging Face revision before release)
- Method: OpenEvo SD-LoRA continual SFT
- LoRA rank / alpha: 4 / 4
- Target modules:
q_proj, v_proj
- Training records: 31 self-generated successful trajectories
- Epochs / optimizer steps: 1 / 8
- Learning rate:
2e-4
- Precision: bfloat16
The training records came from eight frozen WebShop training task identities.
They are intentionally not redistributed here because the benchmark data and
product text have their own provenance and licensing considerations.
Evaluation
The final bounded evaluation used eight disjoint WebShop task identities and
four deterministic rollouts per task for each arm (32 valid attempts per arm).
Both arms used the same prompt/action contracts and decoding settings.
Table with columns: Arm, Valid attempts, Mean task score, Qualified positives| Arm | Valid attempts | Mean task score | Qualified positives |
|---|
| Frozen base | 32 / 32 | 0.053625 | 4 |
| Self-evolution LoRA | 32 / 32 | 0.050000 | 4 |
| Difference | — | -0.003625 | 0 |
The non-zero reward moved from one task identity in the base arm to another
task identity in the adapter arm. This is not evidence of aggregate
improvement, robustness, retention, or transfer.
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
base_id = "Qwen/Qwen2.5-7B-Instruct"
adapter_id = "miyuki17/openevo-h136-qwen25-7b-webshop-lora"
tokenizer = AutoTokenizer.from_pretrained(base_id)
base = AutoModelForCausalLM.from_pretrained(
base_id,
torch_dtype="auto",
device_map="auto",
)
model = PeftModel.from_pretrained(base, adapter_id)
model.eval()
Only the standard PEFT inference files are published. OpenEvo replay buffers,
custom continuation state, and raw experiment logs remain outside this repo.
Reproducibility and limitations
- Source experiment commit:
1d1d83183bfdaa66768559c6d2613aeb5116601a
- Upstream SD-LoRA implementation commit:
8bacded6eb44786db071f66fb90a87dd660d94ea
- Recorded software: PyTorch 2.12.1, Transformers 4.51.1, PEFT 0.15.2,
Accelerate 1.10.1, Safetensors 0.5.3
- The experiment source repository was private at release time; therefore the
exact training launcher is not yet independently downloadable.
- The local base model was byte-verified against the pinned Hub revision before
release; users should load that revision for the closest reconstruction.
- Results cover only this small, frozen WebShop panel and must not be
generalized to other agents, tasks, models, or seeds.
Licenses and attribution
The adapter is released under Apache-2.0, matching the Qwen2.5-7B-Instruct
base model. Qwen is copyright Alibaba Cloud. The referenced SD-LoRA-CL
implementation is MIT licensed. WebShop is a third-party research benchmark;
its raw data is not included in this repository.
Citation
If this artifact is useful, cite the upstream Qwen, SD-LoRA, and WebShop work.
This checkpoint itself is an experimental research artifact and does not yet
have a separate archival publication.