They remove emotion because it clouds judgment. That's why Anakin's love with Padme was against the rules; see what love did to him? By detaching themselves from emotion, the Jedi can be purely objective in their pursuit of knowledge and attempts to keep the universe on the path to Light. Basically, kill the heart so the mind can work freely.