It's safe to say a lot of people on here did not know how easy it is to transmit HSV1 from the mouth to down there (and vice versa, HSV2 aka genital herpes to the mouth can happen). Most people don't get symptoms. It sucks we become "educated" after-the-fact.
Also, some people thought they were extra careful and used condoms, yet they still got it (yup, that's my example). Be thankful you have an awesome family and husband for support. You both can lean together. On the bright side, it's just an occasional "nuisance" and you don't have to worry about disclosing...you know?
However, you both should be somewhat careful with kissing your kids...but I figure you already know how contagious cold sores are (even without symptoms).