Exponentially Weighted Moving Average or Exponential Weighted Average is a very important concept to understand Optimization in Deep Learning. It means that as we move forward, we simultaneously ...