A threat to pull out may cover the fact that this buyer was never serious. You don’t like being messed with. Call their bluff.