This is not normal. I was a kid at the same time and lived in Versailles. We only drank tap water and it was encouraged (the price of bottled water is about 300x the tap water one).

There must have been something seriously wrong with that water - water in France is classified as food and follows very strict regulations.