 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
| • |
The simplest way
to represent things with neural
|
|
|
networks is to
dedicate one neuron to each thing.
|
|
|
|
– |
Easy
to understand.
|
|
|
|
– |
Easy
to code by hand
|
|
|
|
• |
Often
used to represent inputs to a net
|
|
|
|
– |
Easy
to learn
|
|
|
|
• |
This is
what mixture models do.
|
|
|
|
• |
Each
cluster corresponds to one neuron
|
|
|
|
– |
Easy
to associate with other representations or
|
|
|
responses.
|
|
|
| • |
But localist
models are very inefficient whenever the data
|
|
has componential
structure.
|
|