Hey, I ended up getting some assistance from a guy on here who suggested I try joining a group that consists of people from the same area. As I'm in Europe I joined a Europe based group and since then it's worked fine. I still can't hear people who are in America. Don't know if this will help you but it worked for me. Hope you manage to get it sorted.

Thanks a lot! I actually found a video that help me out and now works just fine. It is under the xbox one's privacy settings, there might be something in there to help you. Good luck, here is the video. https://www.youtube.com/watch?v=hxUVpGKKf9I&index=1&list=LLbFFw8vrWyuYGAqKet5c73Q

Awesome, I'm glad you managed to find a fix. Thanks for the video link, will change my settings too. Happy hunting