What binary threshold neurons cannot do
Data Space
(not weight space)
•
A binary threshold output unit
cannot even tell if two single bit
numbers are the same!
Same
:
(1,1)
1;
(0,0)
1
Different
: (1,0)
0;
(0,1)
0
•
The four input-output pairs
give four inequalities that are
impossible to satisfy:
1,1
1,0
0,0
The positive and negative cases
cannot be separated by a plane