Why do we care about probabilities?

I like to say “potential exists, probability is a mathematical description of its distribution.”