The pesticides are not related to honey production but rather to modern farming and consumer practices. So it's not really a downside to consuming honey, but it would be a downside to consuming non-organic (and treated organic) produce, and spraying lawns.
And we're killing them off with pesticides.