Ah, that must be why people complain about my metaphors all the time. I am pretty good at not paying any attention to the baggage, which makes me judge a metaphor just on its merits, whereas other people complain because, ostensibly, they are offended by that.
Given that metaphors are about communication, that people complain about them all the time, and that communication is about other people, you might want to accept that they are bad metaphors.