JamieBeth,
I'd say your best bet is to try and get in to see your GP if you can, or a walk in clinic otherwise. It's not an urgent thing, as your fever isn't dangerously high yet. (though as MrsLiberty mentioned, head to the ER if it heads on upwards of 101) But it will help put your mind at ease, and hopefully the doctor can prescribe you a medicine that has been proven safe for use during pregnancy to help you fight off the cold more effectively.
I'm going through the exact same thing myself right now. I got a chest cold over the weekend and was absolutely terrified to take anything for it, so I just slept and drank orange juice and hoped it would go away. When I eventually gave in 5 days later and went to the doctor she told me it was a bacterial lung infection and slapped with an antibiotic run to clear it from my system. I'm still worried sick about the illness and how it's affecting my baby, but at least now I have enough energy to sit upright and eat solid food.
Your body can do both jobs (take care of you, and make a baby), but you'll probably need to help it along so that you can get better as fast as you can and concentrate on making the healthiest baby you can.

Hang in there.