| Online versus batch learning |
|
|
|
|
|
| • | Batch learning
does |
|||
| steepest descent
on the |
||||
| error surface |
||||
|
|
|
|
|
| • | Online learning
zig-zags |
|||
| around the
direction of |
||||
| steepest descent |
||||
|
|
| constraint
from |
|
| training
case 1 |
|
| w1 |
| w1 |
|
|
| constraint
from |
|
| training
case 2 |
|
| w2 |
| w2 |