Damage is based on weapons attack stat and your armor stat. Low level with maxed weapon would kill you just as quick as high level with same weapon. Difference is you should kill him way quicker if you're good enough to hit him.