There is some conjecture that babies have synesthesia too - so it would be a case of visually receiving sense shape imagery and the brain interpreting that as colours, forms, tastes, pressure, warmth, scents, and such too. Now that seems like enough to make you scream and seek solace in innate behaviours.
Wonder if that's what it's like for a newborn.
https://en.wikipedia.org/wiki/Molyneux%27s_problem