The online HMC learning procedure
1.
Start at a datavector, d, and use backprop to
compute
for every parameter.
2.
Run HMC for many steps with frequent renewal
of the momentum to get equilbrium sample, c.
3.
Use backprop to compute
4.
Update the parameters by :