I think the ability to block/ignore users would be much better than having down votes. If some poster is simply insufferable to a person, better that they have the ability to block than that they silence by downvoting.

And upvoting people you disagree with if they move the discussion forward in a good way is something we all should do, but it is a struggle.