Quite frankly, it's because people would rather not think about things if we don't have to, so we simplify everything in our heads. We judge things in the quickest way possible to see whether or not it's worth further attention, and looking at appearances is one of the many ways people try and do this.