Velamuvi AIAcademy
Deep Learning

Optimizers

SGD, Momentum, RMSProp, Adam and AdamW compared visually, plus learning-rate schedules.

  • Intermediate
  • About 4 hours
  • 1 modules
  • 5 lessons
  • Free

This course is not released yet. We publish courses one at a time, each one complete. The full syllabus is below.

What you will learn

  • OptimisersGradient Descent Recap, SGD and Mini-Batches, Momentum and more

Course syllabus

Not released yet · full syllabus below

  1. 1

    Optimisers

    5 lessons
    1. 1Gradient Descent RecapSoon
    2. 2SGD and Mini-BatchesSoon
    3. 3MomentumSoon
    4. 4Adam and AdamWSoon
    5. 5Learning Rate SchedulesSoon

Recommended next