Ok so here are two things I did to fix this: 1) I dug up an old router and connected it to my modem/router and then back to one of our xbox ones. The idea was to get a different gateway address therefore cancelling out issue. It worked but in my case created a speed issue, the connection was reduced to 6mbps from 39mbs. Also NAT rating became moderate or sometimes strict. This could all be related to the age of the router (15 year old model lol). In any case it does work. 2) Portfowarding + DMZ one of the xbox ones. So after being annoyed that my first solution wasn't working perfectly I decided to give that a try. I set up a rule for each xbox on different ports and DMZed one of the Xbox devices and it worked. I logged on and of 3 times to be sure it wasn't a fluke and it has been consistent for 2 hours. I hope this can help some of you... Edit : to be clear on solution #2 I took the 2nd router out of the equation and went back my modem/router settings.