Time series models
Inference is difficult in directed models of time
series if we use distributed representations in
the hidden units.
So people tend to avoid distributed
representations and use much weaker methods
(e.g. HMM’s) that are based on the idea that
each visible frame of data has a single cause
(e.g. it came from one hidden state of the HMM)