Sigmoid neurons
	• These give a real-valued output that is a smooth and bounded function of their total input. – Typically they use the logistic function – They have nice derivatives which make learning easy (see lecture 3). • If we treat      as a probability of producing a spike, we get stochastic binary neurons.
							1
						0.5
								0
															0