| The network |
|
|
|
|
|
|
|
|
|
|
| • | You have to
decide how many experts to use |
||||||||
| and how
complicated each expert should be. |
|||||||||
| • | You also have to
decide how complicated the |
||||||||
| gating network
should be. |
|||||||||
| • | In addition to
training the whole system as |
||||||||
| described in the
last part of the 1991 paper, you |
|||||||||
| should experiment
with “speciation” (see next |
|||||||||
| slide) and see if
you can make it work better |
|||||||||
| than a “standard”
mixture of experts. |
|||||||||