Not really to the point of 'knowing them'... that is being a friend, (a few), but meeting them in social settings.
You bring up an interesting point. I don't think I ever met even ONE that wasn't inspired by every genre of music... and extremely knowledgeable about them.. classic music, Jazz, Gospel, Blues, R&B, you name it. Jerry Garcia was a HUGE fan of Dolly Parton of all people.
(I like her as well).
Can't think of any that I met that didn't have a full collection of music spanning all genre's... even if they never recorded said genre or played it in public. BUT THAT SAID....
I think you're right... Jazz I believe would be the most common denominator for drummers. I know it is for me.