We can't shoot the second energy sphere to open the portal. We were able to shoot the first portal if we shot it fast enough after the high celebrant disappeared, but if not then we were unable to damage it, as well.