I've found it only bothers me when people are slow when I don't respect the reason for being slow. Like, if you're straight in and a stop shot will serve just fine, I don't want to see you taking more than 20 seconds to figure it out. On the other hand, when I freeze you to that blocker and you've got to go six rails to kick out of it or you lose, it doesn't bother me at all that it's taken you ten minutes to map it out.
The trick on how to handle this is to maintain that respect. If they're straight in, assume it's off-angle. Assume there's something about the shot that you simply can't see. Stay in that mindset. Yes, this is a bit of a mental game but this is how you win that game.