They never left. A large contingent of them were eradicated during the battle of Installation-04b, but that was far from all of it. Plenty of specimens still exist on the remaining Halo rings, as well as numerous other Forerunner facilities. It's only a matter of time before the Flood will once again threaten the galaxy.