That's just how it is. GG is still very much a beta thing at the moment. Realize they have no way to distinguish between an unintentional crash and you pulling your ethernet cable in rage. They want to discourage people rage-quitting, and so it just gives the debuff either way. Frankly, you're just better off using LFG to find people. Perhaps just friend the people you meet in GG, and run NF with them normally?