Learning rate schedulers

PyTorch Developer Podcast

Jun 13 2022 • 19 mins

What’s a learning rate? Why might you want to schedule it? How does the LR scheduler API in PyTorch work? What the heck is up with the formula implementation? Why is everything terrible?

You Might Like

Darknet Diaries
Darknet Diaries
Jack Rhysider
Hard Fork
Hard Fork
The New York Times
Marketplace Tech
Marketplace Tech
Marketplace
WSJ’s The Future of Everything
WSJ’s The Future of Everything
The Wall Street Journal
Acquired
Acquired
Ben Gilbert and David Rosenthal
TechStuff
TechStuff
iHeartPodcasts
Rich On Tech
Rich On Tech
Rich DeMuro
The Vergecast
The Vergecast
The Verge
Fortnite Emotes
Fortnite Emotes
Lawrence Hopkinson
Waveform: The MKBHD Podcast
Waveform: The MKBHD Podcast
Vox Media Podcast Network