The reason the 'One' ball keeps rolling off is due to a "divot" in the cloth/spot. This divot was caused from a downward force on the 'One' ball, upon impact with the cueball, when breaking. This is because, on a break shot, the cueball actually leaves the surface of the table, along it's path to the rack. When it makes contact with the 'One' ball, the 'One' ball becomes "trapped" between the cueball and the rest of the rack, causing it to be forced downward into the cloth, thereby creating a "divot" in the cloth.
Brushing the cloth in the rack area may help even out some of these divots. However, there is absolutely nothing wrong with LIGHTLY tapping the 'One' ball into place, creating a new "divot", in the correct location. This does not harm the balls, as the balls are of equal hardness, and were designed to contact one-another, AND you are only tapping hard enough to slightly deform the cloth/spot, not pound a hole in the slate.
In disagreement with a previous post, use of the Magic Rack DOES NOT require the use of Super Pro balls. Using a higher quality ball will provide a tighter rack, BUT even a low quality ball set may be manipulated within a Magic Rack, to produce a tight rack. Granted, if the balls vary greatly in size, you will never get a tight rack, regardless of the method you choose. However, you do not need to go out and spend a fortune, just to achieve a tight rack.