In my city, you can often find rows of houses for sale for $5-10k a piece from slum lords trying to exit the business. Tearing down the old homes would probably be expensive, but I think the city even has a program to help with some of that. Since you could effectively buy a whole street, the safety implications might not be as bad as initially assumed.