Speak for yourself. I've chosen all of my jobs based on a pretty robust combination of (a) income, (b) technical challenges, (c) project, (d) people -- the team + the management. I don't think I've ever taken a job where (c) and (d) weren't major factors in my decision, and I've repeatedly quit lucrative jobs for substantially less lucrative ones because I was dissatisfied with either the project or the people at my current gig.

I know there are plenty of people out there for whom life is relationships and hobbies, and career is a way of subsidizing life. That's a totally respectable set of priorities. There are also a lot of people, especially in the startup world, who want more from their career than a comfortable job and a paycheck. It's not crazy for a founder to seek out candidates who are motivated by those other more enduring (and cheaper!) factors of love of the team and belief in the mission.