Versatile hot and cold water dispenser for home or office