Im primarily a solo player as well, but I'll still do things like the Raid, Nightfall, and Trials with teams, I just won't talk unless need be. All I do is mute my mic and listen in on the group, it's never stressful, I'm never worried, and the group never talks to me unless they need to ask me something, it's simple, easy, and it works.