I have installed this in a drinking water dispenser but now it tastes funny once in a while.

What brand are you talking about? A water filter system you purchased and installed probably will not filter water enough to drink it safely. When bacteria builds up in a water filter it is much dirtier than you can imagine, especially with poisons excreted by the bacteria. You need a filter that flushes itself out twice a day to be safe.