Yes and no. :)
If you apply a force to an object, its center of mass accelerates immediately according to: a = F/m. If, for instance, you designate a swarm of rocks stretching from here to the nearest star as an 'object,' and push on just one of the rocks near the earth, the center of mass of...