I think the best way to overcome that is being brutal about releasing early and often. If you are shipping to actual users every few days and then seeing how users react to the new thing, the occasional goof isn't a big deal. Indeed, it's a great way to learn some valuable humility.
100%, "bias for action" as they say. Delivering something regularly and creating a loop that including customers/users etc will help form good habits. Lots of positives will flow from this I've found.
