It does matter. If you pay attention there is a very distinct difference when fighting enemies of different levels. As a 27-28 depending I can guarantee that it is easier to kill 27 and below and harder to kill 28 and above. If you can't tell that much from simply playing, then perhaps you should check again.