I feel for you because I was on the same boat with that linen cloth on the shaft. With wood you either need to wear gloves or put powders, alternatively this is another solution which is a linen material wrapped around the shaft. Because lets face it wood is very sticky especially with sweaty hands which is what I had before, in fact I hate gloves soo much that I didn't know what to do. I had to either powder up which ruins the table, or wear gloves and I hated both.
Finally I found the solution, not using linen cloth like in your picture because its just like gloves which thickens the shaft alot & not to mention you wont have this natural feeling for position with that cloth, maybe you'll disagree here but you wouldn't know you're wrong until you see the other option. The real solution for this is CF shafts, yes I said it....carbon fiber, no gloves, no powder, no silly linen cloth.....its so smooth that I dont hear the sound of my hand while stroking like I did with wood. I love it!! I suggest you switch to CF, even if you're the typical "Oh i'm not into technology and i love the old stuff" still, give it a go.