The violent behavior is inexcusable, period
That said, there is shared responsibility to
- keep track of time
- discuss how will be handled if you go over time
- you did agree to an hourly rate
I doubt you have a legal issue here, even with the threats to call your wife and aggressive (though not violent) behavior.
Going to the police will surely put this "on the record" and possible in the public eye, which I assume you don't want?
I liken this experience getting mugged (which thankfully I never have but my apartment has been robbed) .... you feel completely violated and like someone kicked you in the gut.
I'd chalk this up to a naive mistake (on your part) and feel fortunate the guy did not get violent or call your wife.
We're tinkering at times with the underbelly here guys, do your homework and even then "shit can happen"
JC