You only mention male reactions to guilt about adultery. What about women? I had sex a few times with a woman who had a boyfriend and then called me up one night to say that she had never cheated on anybody in her life before and felt too guilty about it that she didn't think that she could do it anymore. I said simply, "Don't then." I don't think that it was the response she expected. Three months later and having broken up and then got back together with her boyfriend she was asking me to go to a fancy spa with her for the weekend. So, there was a clear lack of self knowledge about who she was as a sexual being in my opinion.
I have also slept with a few married women and they all want that initial passion and dopamine rush that a new lover provides and unless they are using the man to get out of the marriage (and that happens) they invariably feel some degree of guilt at some point. My advice to them has always been, 'if you feel guilty don't act on it and for God's sake don't ever confess in a misguided attempt to expiate your guilt, just let time pass and over time the feeling of guilt will diminish and you will be left with merely some fond memories of an intense experience and an adventure that you had'.
Finally, let me say that based on my observations, that when it comes to adultery men always get caught because they are stupid and/or naturally boastful about the sex they get and women only get caught when they want to.