Phenolic tips scuff the ball. Maybe this is less with the new chalk, but with traditional chalk, it is very visible if you look for it. Miscues seriously scuff, burn, and mark the ball. If there's chalk on the cue ball, it can scuff the object ball.
Aramith ball cleaner should be able to fix...