I think this is your imagination. I only say this because when I clean mine, the break spreads much better.
When they are dirty I find they skid more, but haven't seen them roll any faster.
I bet there are a bunch of people on here that have some scientific reasoning for this.