Both contain the same abrasive, but one has smaller abrasive particles, the other larger. Sort of like the difference between 1000 grit sandpaper and 1200 grit sand paper.
The softness/hardness of the chalk comes from the binder (that is the colored part of the chalk).