s-nlp/lora_fwsvd

This repository provides the code implementation for the paper: "Memory Efficient LM Compression using Fisher Information from Low-Rank Representations"