I am having this issue too sometimes. 99% of my time is spent on netflix, and thats where i notice it. I believe its just a problem with the controller, since when its plugged to my phone, or pc, or wirelessly in the console, its working fine.
DS4 are cheap and bad quality.
What headset are you using? Im using the elite pulse with the wire that came with it.