Layer Update Similarity and Warm-Started Distillation for Depth Compression of Large Language Models
Under review at IEEE Transactions on Neural Networks and Learning Systems
Recommended citation: M. Usama, "Layer Update Similarity and Warm-Started Distillation for Depth Compression of Large Language Models," IEEE Transactions on Neural Networks and Learning Systems, 2026.