I don't know how long it can keep your temps up, but progesterone does keep my temps elevated a few days past finishing it (until AF is completely here). Remember that it can take a little while to bring on AF when you finish the progesterone.
And yes, I know exactly what you mean about secretly hoping you did.