It is understood that the so-called reality gap, the unavoidable differences between simulation and reality, typically causes neural network to be less effective on real robots than what is predicted by simulation. In its typical application, known as off-line automatic design, the neural networks controlling the robots are optimized in simulation. Neuro-evolution is an appealing approach to generating collective behaviors for robot swarms.
