A different kind of hidden structure
•  
•Instead of trying to find a set of independent hidden causes, try to find factors of a different kind.
•
•Capture structure by finding constraints that are Frequently Approximately Satisfied.
•
•Violations of FAS constraints reduce the probability of a data vector. If a constraint already has a big violation, violating it more does not make the data vector much worse (i.e. assume the distribution of violations is heavy-tailed.)
•
•