I do agree with this, personally. There is a game called warface with a system like this- a party member can initiate a kick vote and if the majority of the players vote yes then that particular player is kicked. It works quite well.