You know you’re right, but it isn’t worth saying so. Offer to follow the other person’s lead and they’ll eventually ask you for directions.