Besides losing a revive, is there a downside to being defeated by an invader?
-
Literally none...and honestly sometimes it's just better to let them take your 3 lives and crests so they just leave. Unless you are able to duel well enough of course.