Ha ha! I know lots of men like that who joke to get ‘a rise’ from women. A good reply (only, hard to think of at the time) might have been:

“Oh. I’m so sorry. You must be black and blue.”