Doing drugs is immoral because it compromises your ability to serve your community and live up to the expectations and responsibilities that come with living in a society.
If you can keep your life balanced while on drugs, good for you. But you're still toying with the risk of you getting addicted and losing control; to even take that risk is selfish.