“Uni-gauss” experts
Each expert is a mixture of a
Gaussian and a uniform. This
creates an energy dimple.
Mixing
proportion
of Gaussian
Mean and
variance of
Gaussian
range of
uniform
Gaussian
uniform
p(x)
E(x) = - log p(x)