Unless you were lucky enough to get your "optimal" or "desired" build, meaning you have the right amount of Intellect, Discipline, and Strength for your character then you have no reason to waste your shards yet seeing as there is no reason be 32.
[spoiler]32's are dumb...[/spoiler]
-
Extra 8000 damage per hit with the swords makes it worth will there aswell