With the number of people that have been swept up in cults over history the entire idea that "people can just easily leave" doesn't seem to pan out well.