It all comes down to personal preference. I had a PS4, but made the switch to X1 and absolutely love it. It's a better online experience, although Live has its issues as well, much more competitive community, and I like that Microsoft rolls out updates each month to improve said experience. I know people rave about how great the PS controller is, but it was just too small for my hands and lead to cramping. Also, I am a big Halo/Gears fan, so that factored in quite a bit as well.

As a person that has both versions, it's pretty much the same game. You will only be missing out on the exclusives. I also hate the Xbox way of starting a party with randoms but that's just me