GLM-5.3 is live. Run Z.ai's latest model on Friendli Model APIs. Try it today ➜
mremila
Available on FriendliAI
Run this model inference on single tenant GPU with unmatched speed and reliability at scale.
Model Details
Model Provider
mremila
Model Tree
HuggingFaceH4/zephyr-7b-beta
Input Modalities
Output Modalities
Supported Functionality
trainers.tr_tar.TARMETrainer; 16 inner steps.1e-5, 16 inner samples, inner batch size 1.1e-5, 125 optimizer steps, microbatch size 40.cais/wmdp-bio-forget-corpus, training split.Salesforce/wikitext, wikitext-2-raw-v1, test split.Zero-shot lm-eval accuracy for this exact checkpoint:
| Task | Accuracy (%) | Standard error (pp) |
|---|---|---|
| wmdp_bio_robust | 42.28 | 1.68 |
| mmlu_no_bio | 53.61 | 0.41 |
The metrics are also saved in eval_results.json. See training_config.yml for the complete run configuration. Results are specific to these training and evaluation settings.
python
from transformers import AutoModelForCausalLM, AutoTokenizer repo_id = "mremila/z7b-wmdp-bio-5pp-unlearn-fft-me-tar-k16"tokenizer = AutoTokenizer.from_pretrained(repo_id)model = AutoModelForCausalLM.from_pretrained(repo_id, dtype="auto", device_map="auto")MIT, matching the Zephyr-7B-beta base model.