Not every man in the world is right for you and no other man is the right father for your kids.
Stay cool and still tell him your love if you feel like telling. Unconditional love is the best love in the world and really hard to find beyond direct relatives. Your husband will understand and appreciate that. Even if you end up in divorce, he will remember that and may regret the divorce down the road.
Men may go astray for whatever reason. But they also have insecurities about their future relationships, no matter how good it looks now.
It is good that you are thinking of going to see therapist. That is the right thing to do. But you have to acknowledge that there have been problems in your marriage. Either of you has work to do if you want to repair the relationship.