Abstract: We proposes a new normalization method, Sparse Group Normalization (SG-Norm), which aims to address the computational efficiency bottleneck faced by deep neural networks when processing ...