Compute the moments and .
Standard gradient given the gradient with respect to the moments, that is, given the Riemannian gradient :