Model Details

• Developed by: Suryash Yagnik, Shubham Gaur, Saksham Thakur, Vinija Jain, Aman Chadha, Amitava Das
• Model type: LoRA adapter
• Base model: meta-llama/Llama-3.2-3B
• Method: Multi-phase Adapter-Aware Targeted Unlearning (MAAT)

Summary

The MAAT framework establishes a new operating point on the forget-retain Pareto frontier. It achieves high forgetting and high retention on causal knowledge by:

1. Gradient Policy Ascent: Using orthogonal projection to remove retain components from the forget gradient.
2. Structural Compression: Pruning rank dimensions via SVD profiling.
3. Utility Repair: Applying a multi-objective engine to maintain performance on the retain set.

Citation

bibtex
Copy code
@article{yagnik2026maat,
  title={MAAT: Multi-phase Adapter-Aware Targeted Unlearning},
  author={Yagnik, Suryash and Gaur, Shubham and Thakur, Saksham and Jain, Vinija and Chadha, Aman and Das, Amitava},
  journal={arXiv preprint arXiv:2605.30514},
  year={2026}
}