if you are having second thoughts i think you should just follow your instincts, its okay to latch him back on and go with the flow. You milk supply can come back up as quickly as it can go down. I think people get too uptight about weaning. With Chelsea I had her down to 3 feedings a day, then when we were moving to Cali i BF her full time for two months because it was just easier.
On the other hand if you know deep down its time to part ways with BFing then just do it, and feel good about getting your freedom and your body back! When a door closes a window opens right?