The issue is time. How LONG does it take the pass rushers to get to the QB, because given time they all will.
So, you could get pass rushers that get there very quickly. Or if you lack that, you can create a secondary (and LBs) that cover a half-second longer allowing more time for the pass rushers to get to the QB.

It's not just.... get more pass rushers. There's many ways to effectively defend the pass.