PyTorch Developer Podcast
Jun 13 2022 • 19 mins
What’s a learning rate? Why might you want to schedule it? How does the LR scheduler API in PyTorch work? What the heck is up with the formula implementation? Why is everything terrible?