Normalization methods in DNNs; today's reading.

deep-learning normalization today-i-read whitening-transformations

  1. Lei Huang, Jie Qin, Yi Zhou, Fan Zhu, Li Liu, and Ling Shao, “Normalization Techniques in Training DNNs: Methodology, Analysis and Application,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, no. 8, pp. 10173–10196, Aug. 2023, doi: 10.1109/TPAMI.2023.3250241.

    tl;dr: A review and commentary of normalization methods in DNNs. I skimmed this one. Good for definitions of all of the normalization terms and especially Figure 1.

© Amy Tabb 2018 - 2023. All rights reserved. The contents of this site reflect my personal perspectives and not those of any other entity.