What the network learns
We used recurrent back-propagation for six time steps
with the sememe vector as the desired output for the last
3 time steps.
The network creates semantic attractors.
 Each word meaning is a point in semantic space and
has its own basin of attraction.
Damage to the sememe or clean-up units can change
the boundaries of the attractors.
This explains semantic errors. Meanings fall into a
neighboring attractor.
Damage to the bottom-up input can change the initial
conditions for the attractors.
This explains why early damage can cause semantic errors.