A list of EPA approved cleaning and disinfecting products can be found here.
IMPORTANT
Ensure cleaning and disinfection products are listed under manufacturer's instructions as appropriate for use on household kitchen and bath faucets.
Follow manufacturer's instructions for use regarding concentration, application method, and contact time, etc.
If the filter has not been replaced recently, this may be the cause. Be sure to replace the filter every 6 months.
If the dispenser is newly installed, check the water connections for use of plumbers putty or sealant. Sealants do not need to be used and may affect the taste and odor of the water. Clean off the sealant, reattach the connections, and let the water run to refresh the water in the tank.
Check that the tank is connected to your home's cold water supply. Generally, chlorine or contaminants are more noticeable in hot water. Connecting the tank to the hot water supply can exacerbate the taste or odor. Using a filter can eliminate any bad taste or odor.