We actually had the opposite idea, where we'd steal a few kbps from the video to increase the audio. If you hear poorly compressed audio, the video feels bad too. Hearing clean audio made the video feel better. However, this was way back in the early days where 700kbps total bitrate were on the high end pre-AAC