Every time I switch between special or heavy guns I lose all my ammo for that class of weapon. I can change the primary guns and I don't lose ammo.
The game is designed this way. If you're switching Special and Heavy weapons DURING a game, you're suppose to lose all the ammo. It's enticing to keep the same weapons, rather than constantly swapping them out, it's a small penalty.