When they do that you either just throw nades at them to flush them out, you team primary shoot them, or just camp the cap point and wait for them to come.