In some sports, yes physiological differences between men and women are going to give men the edge. But there are many that women can and do perform at the same level and even better in some cases - and those cases are growing as women are being given more of a chance.

However, being funny is not a physiological condition. So it really does not explain away your belief.