Evolving Deep Learning Optimizers [R]
·
0 reactions
·
0 comments
·
1 view
We present a genetic algorithm framework for automatically discovering deep learning optimization algorithms. Our approach encodes optimizers as genomes that specify combinations of primitive update terms (gradient, momentum, RMS normalization, Adam-style adaptive terms, and sign-based updates) along with hyperparameters and scheduling options. Through evolutionary search over 50 generations with a population of 50 individuals, evaluated across multiple vision tasks, we discover an evolved optim
Original article
Machine Learning
Anonymous · no account needed
Discussion
0 commentsMore from Machine Learning
Visualizing Loss Landscapes of Neural Networks [P]
Machine Learning·12
How do I actually learn AI/ML deeply enough to build systems (not just follow tutorials)? [D]
Machine Learning·3
ICML final decisions rant [D]
Machine Learning·8
Real World Physics-Informed AI Applications [D]
Machine Learning·4
Looking for feedback on OpenVidya: an open-source AI classroom layer for NCERT/CBSE [R]
Machine Learning·9
[D] Self-Promotion Thread
Machine Learning·13