There is currently no way to use push to talk while using a controller. The only option is to leave mic open. Using workaround programs (like Steam Input or DS4Windows) to emulate a keyboard press does not work as the game will only register whatever input method (KBM or controller) was most recently used, so you can't move a joystick and push to talk at the same time, for example.