Letting your friends have your number is a separate setting you can turn off (at least for now). This is about friends who have your number being able tell that it is your number, I think.