You did the right thing.
Those sorts of situations never end well. Some big mouth bastard like that could file assault charges against you (which could get expensive) rather than take his ass beating like a man.
-Now, if it were a dark alley with no witnesses-it's curb time!