I didn't think I cared until I had a male doctor. It was just awkward for me. Then again, I work at the hospital so it was really just weird when I went back to work and ended up making him a coffee. It was like "oh hi, you just saw me naked, here let me make you a latte."
I still see him as my primary care doctor, but I'm starting to see a female ob/gyn at the women's health clinich anyway. My dr refered me to her so it's all gravy. No more embarassing moments for me hopefully.
Edit: I just wanted to mention that my dr was very nice when he stopped by the coffee shop. He just pretended like he didn't know me. (and yes that was nice) It was just that first initial "Oh hey... uh" and then I looked away. I think he saw me blush and spared the small talk. LOL