Deep Learning · Efficient Training Methods

TitleAuthors
A Fourier Perspective on Model Robustness in Computer VisionDong Yin · Raphael Gontijo Lopes · Jon Shlens · Ekin Dogus Cubuk · Justin Gilmer
A Graph Theoretic Framework of Recomputation Algorithms for Memory-Efficient BackpropagationMitsuru Kusumoto · Takuya Inoue · Gentaro Watanabe · Takuya Akiba · Masanori Koyama
A Mean Field Theory of Quantized Deep Networks: The Quantization-Depth Trade-OffYaniv Blumenfeld · Dar Gilboa · Daniel Soudry
AutoAssist: A Framework to Accelerate Training of Deep Neural NetworksJiong Zhang · Hsiang-Fu Yu · Inderjit S Dhillon
Backprop with Approximate Activations for Memory-efficient Network TrainingAyan Chakrabarti · Benjamin Moseley
Bridging Machine Learning and Logical Reasoning by Abductive LearningWang-Zhou Dai · Qiuling Xu · Yang Yu · Zhi-Hua Zhou
E2-Train: Training State-of-the-art CNNs with Over 80% Less EnergyZiyu Jiang · Yue Wang · Xiaohan Chen · Pengfei Xu · Yang Zhao · Yingyan Lin · Zhangyang Wang
Hybrid 8-bit Floating Point (HFP8) Training and Inference for Deep Neural NetworksXiao Sun · Jungwook Choi · Chia-Yu Chen · Naigang Wang · Swagath Venkataramani · Vijayalakshmi (Viji) Srinivasan · Xiaodong Cui · Wei Zhang · Kailash Gopalakrishnan
Initialization of ReLUs for Dynamical IsometryRebekka Burkholz · Alina Dubatovka
Invert to Learn to InvertPatrick Putzky · Max Welling
Learning Data Manipulation for Augmentation and WeightingZhiting Hu · Bowen Tan · Russ Salakhutdinov · Tom Mitchell · Eric Xing
Robust Bi-Tempered Logistic Loss Based on Bregman DivergencesEhsan Amid · Manfred K. Warmuth · Rohan Anil · Tomer Koren
When does label smoothing help?Rafael Müller · Simon Kornblith · Geoffrey E Hinton