I too have little white things floating in my water, but I only see them when I use the tap water to make ice cubes. When the ice cubes (made from filtered water - a Pur water filter attached to the kitchen faucet) melt in a drink, little white pieces of what looks like particles of puréed toilet paper or mucus swirl in the glass and eventually settle on the bottom. This only happens when the water is frozen and then melted. There is no debris visible in the water coming out of the Pur Filter, or even the straight out of the faucet.
I have no clue where to begin looking for identification or solution to the problem. It really is gross to drink half a glass of water and then see things swirling around in it.