I hate 'what if's'. But, I believe you did the right thing, for you. And I admire you. It is completely normal to wonder that what if's...And I think it's awesome that you married the love of your life...you don't need a lady friend, to fulfill your sexual side.
I know we all have different lifestyles...but, I am the kind that would be with a girl, if she came along...with the hubby's permission.
But, for the kind of people like you. I truly admire you
I think you're a wonderful wife and mother...regardless of your what if's.