Least mean squares: An alternative approach for
really big datasets
weights after
seeing training
case  tau+1
learning
rate
vector of derivatives of  the
squared error w.r.t. the
weights on the training case
presented at time tau.