Part of the core human experience is to estimate these parameters in social settings. It's how we make friends, evaluate social situations, and navigate life. I can't imagine being told we should wear blindfolds. Why would it not be appropriate for computers to do so?

It's not like we'd be using these algorithms to make hiring decisions. We already have a lot of protective legislation on the books.