If you drop into a game or other members in the game leave early, it may cause the game to be forfeit for the Challenge and bounties. The same can happen if you perform so extremely badly that the game decides you were pretty much afk or not actually trying. Unfortunately, the only thing to do is continue trying until you get them all.