Model details
- Base model:
EleutherAI/gpt-j-6b
- Forget-set selector: Gotcha
- Forget-set size: 452 examples
- Unlearning method: PURGE with binary code reward
- Training: 20 epochs, 4 generations per prompt
- Checkpoint format: full Transformers checkpoint in Safetensors format
Intended use
Research on vulnerability-oriented membership inference, machine unlearning, and secure code generation. This is a causal language model for code/text generation, not a security guarantee or a production security scanner.
Evaluation note
The checkpoint is released for reproducibility. Evaluation metrics should be reported together with the exact benchmark version, selector construction, decoding settings, and Bandit/HumanEval environment used to produce them.
Limitations
The model can still generate insecure, incorrect, or harmful code. Generated code must be reviewed and tested before use. Unlearning performance is specific to the supplied forget set and evaluation protocol.
License
This derivative checkpoint follows the license and use restrictions of its base model: apache-2.0.