Backpropagation with weight constraints
	• It is easy to modify the backpropagation algorithm to incorporate linear constraints between the weights. • We compute the gradients as usual, and then modify the gradients so that they satisfy the constraints. – So if the weights started off satisfying the constraints, they will continue to satisfy them.