Traumatised, bullied children, wife having to deal with the fall out and pick up the pieces.
I think if the two of them had been in the same type of job they'd both have lost theirs. Joe is only "lucky" he is in a profession (and I use that word guardedly) where bleeping around and being a "lad" is encouraged or ignored.
I can understand why the "other woman" lost her estate agent role for the reasons discussed before, and Rimmerman is putting a brave face on it for the paps probably, but it does strike me as rather smug of him to grin away, especially when others are suffering.
Made me think of Jon Ronson's "So You've Been Publicly Shamed" book - people can take their lives over this. It's serious stuff.