Exponential technologies have a tendency to move from a deceptively slow pace of development to a disruptively fast pace. We often disregard or don’t notice technologies in the deceptive growth phase, ...

Exponentially Weighted Moving Average or Exponential Weighted Average is a very important concept to understand Optimization in Deep Learning. It means that as we move forward, we simultaneously ...