I never minded being "silent" in my 2000 or so hours in Fallout and Skyrim, because I was able to choose my dialogue if not hear it. That worked. This... doesn't. It's been an issue since "Rise of Iron", and in D2's more fleshed out story, it's worse.
Most of D2's PvE experience is excellent. This includes most of the cutscenes. But the ones featuring our Guardian are just awkward.