Unique Products sells a Shaft Cleaner that works very well.
It has micro-bits in it that help clean the chalk out of the wood grain.
Put that on some Mr Clean micro fiber scrubbers and you will be amazed.
You rub it in with the grain of the wood and then wipe it off.