While you did indeed put in the bulk of your D1 time on your PSN account (501hrs), with only just shy of 47hrs on your Xbox account; your Destiny 2 time has only been on your Xbox account, with no D2 history for your PSN account. As nothing transferred from D1 to D2, other than the physical appearance of characters, a few emblems (if qualified), and a small change in some original campaign dialogue; you are not really missing anything. Your PSN account would be starting completely fresh, no gear, no exotics, no progress. Definitely not worth deactivating cross-save, as you have over 428hrs on your Xbox based characters, along with the various goodies you’ve earned in that time.