I just used pre-boiled water. I'm going to be feeding her her normal bottle first, then the puree after as a bonus, not a replacement, so I just went ahead and used water.

I figure she'll still get all the benefits of the formula first, so it's not like she's losing anything with the puree. I think if I was going to be cutting down on her bottle I'd mix some formula in with the puree.