Just because you're 300 light doesn't give you an advantage over 100 light enemies. The game adjusts itself to keep you at their level.

The people you were with didn't understand that your level was fine.