This tool is the way to go. I used one for years before I bought my lathe. Like mentioned above, make sure you wrap something around the area on which your clamping. I used a few small post-its wrapped around the shaft. The tool is also great for a flat area to prep your tip.
EDIT: Just remember to go slow with the sander. It's better to take your time, than to take off too much ferrule material.