This whole thing depends, is he always like this when something happens?
Getting home slightly late ocassionally is an occupational hazard, you don' have control of traffic, public transport etc.
He does have control over what he says to you.
Soooo, would he be delighted if you quit work and decided to stay home, or do you work out of necessity (I would love to stay home), after all you won't ever be late home that way. If not I would have strong objections to coming home exhausted from work to a barrage of bad language......
You guys need to sit down when calm, and agree to a few rules, neither of you swears at one another nor calls eachother names, you do not wish one another dead, if either of you cannot think of anything nice to say its generally best to keep quiet.
On the other hand, next time you're late home from work for whatever reason, dont joke about it he obviously takes it as you not being adequately concerned about it.
May Allah put love between your hearts.