That does sound like a UTI. I've had problems with them recurring for a long time now. I had one almost a year that just wouldn't go away!
Drinking lots of water is good, also pure cranberry juice or even better, natural cranberry supplements. I'd definitely buy those. If your symptoms are really bad (it's gone to a point of being unbearable for me), you can get relief from AZO brand urinary tract infection symptoms relief medication. You can find it for like $6-7 at Walmart/Target etc. I'm not sure how safe it is for TTC though. Also, it helps to wear loose fitting pants, like sweats or yoga pants and go commando for a day or two.
I'm serious, it makes a difference. It gives you a chance to "air things out" because bacteria breeds in extra heated areas, so keep it airy and clean.