That's a bugger @ling 
I hope that you are both able to attend some counselling together, to give your relationship a chance of surviving, assuming you don't want this to wreck your marriage?  Your trust in him needs to be rebuilt if this is to suceed.  Then draw a line in the sand & start over.
I would imagine that you are feeling angry, betrayed, disappointed, sad - whilst he obviously was feeling guilty, guilty, guilty ...
All the best on the path that you take from here.  xxx