Its time-gated to act 2. After you get 12 of those thingys, it tells you to get The Moment of Clarity upgrade from the vendor… which isnt available until act 2. I did the same thing with collecting the fragments. Hopefully it ddoesnt bug out when act 2 starts.