I wish I was educated enough about biology to have a credible stance in this debate. If I were to hazard a guess. In terms of 'non-athletic sport", (pool, darts, chess, etc). I believe this simply boils down to men generally having a much higher desire to assert dominance. I know every man would agree with me that we are hardwired to compete and establish ourselves among the best of whatever activity is placed before us. If we find that we can't dominant. We either move on, or make excuses. Accolades comes with success, and every guy wants to do the head cheerleader. With that established, the effort and focus men need by default in physical competition against peers is in orders of magnitude of greater importance to them, then it is for women.
I underlined 'physical competition' because intellectual dominance doesn't get you the cheerleader. Possibly the trophy wife decade or two later.
Not saying women can't be success driven. Out of the box, they're just not wired that way, and for men (boys) it's what drives us.