Is this pruning methods common for multiHeadAttention

[shoveller86]

As the document tested the BERT models and got good result, one question is this nn_pruning methods can be applied to other Transformer models, like Google ViT, Swin Transformer and so on.

[thedatamask]

Understanding Pruning in Neural Networks | Types, Layer-wise Impact & Interview Prep! All in one video here...

https://www.youtube.com/watch?v=RSHM57jf7Z8

#DeepLearning #ModelPruning #NeuralNetworks #AIInterviewPrep #MachineLearning #MLOptimization