On the SDEs and Scaling Rules for Adaptive Gradient Algorithms
Sadhika Malladi$\text{ }^{*}$, Kaifeng Lyu$\text{ }^{*}$, Abhishek Panigrahi, Sanjeev Arora Published at: Neural Information Processing Systems (NeurIPS), 2022
Publications
Understanding Gradient Descent on Edge of Stability in Deep Learning
Sanjeev Arora, Zhiyuan Li, Abhishek Panigrahi $\text{ }^{(\alpha-\beta)}$ Published at: International Conference on Machine Learning (ICML), 2022
Learning and Generalization in RNNs
Abhishek Panigrahi, Navin Goyal Published at: Neural Information Processing Systems (NeurIPS), 2021
Effect of Activation Functions on the Training of Overparametrized Neural Nets
Abhishek Panigrahi, Abhishek Shetty, Navin Goyal Published at: International Conference on Learning Representations (ICLR), 2020
[paper]
Word2Sense: Sparse Interpretable Word Embeddings
Abhishek Panigrahi, Harsha Vardhan Simhadri, Chiranjib Bhattacharyya Published at: Association for Computational Linguistics (ACL), 2019
Oral presentation (270/3000 submissions ≈ 9% Acceptance Rate).