I'm not saying which was the hardest one to fight... I'm asking which one just scared you into retreating the most until you levelled up.
For me it has to be, hands down....
[spoiler]The waves of Thralls. Damned things had me backpeddling like crazy the first time I came across them... and still did when they came boiling out of the Temple on the Moon.
In fact, the Thrall just creepy as *BLEEEEEP*[/spoiler]