Relationship to causal generative models
Consider the relationship between the hidden
variables of two different experts:
Causal            Product
model             of experts
Hidden states
unconditional
on data
Hidden states
conditional on
data
independent
(generation is
easy)
dependent
(rejecting away)
independent
(inference is
easy)
dependent
(explaining away)