| Online versus batch learning |
|
|
|
|
|
| Online learning updates the |
||||
| weights after each training |
||||
| case. It zig-zags
around the |
||||
| direction of
steepest descent. |
||||
|
|
|
|
|
| • | Batch learning
does |
|||
| steepest descent
on the |
||||
| error surface |
||||
|
|
| constraint
from |
|
| training
case 1 |
|
| w1 |
| w1 |
|
|
| constraint
from |
|
| training
case 2 |
|
| w2 |
| w2 |