MO
MostafaShams5/FISH-Tuning-Implementation
PyTorch implementation of the paper "FISH-Tuning: Enhancing PEFT Methods with Fisher Information" (2025). A drop-in improvement for LoRA that automatically freezes unimportant weights. Helps you save memory and train highly sparse models without losing accuracy.