Density models
Causal models
Energy-Based
Models
Tractable posterior
mixture
models, sparse bayes nets factor analysis
Compute exact posterior
Intractable posterior
Densely
connected DAG’s
Markov Chain Monte Carlo
or
Minimize variational free energy
Stochastic hidden units
Full
Boltzmann Machine
Full MCMC
Restricted
Boltzmann Machine
Minimize contrastive divergence
Deterministic hidden units
Markov
Chain Monte Carlo
Fix the features (“maxent”)
Minimize contrastive divergence
or