Because hours of effort, marketing, etc aren't accounted for in the price of your DIY.

The hi-fi speaker business is a highly competitive market. The invisible hand already drives prices to about where they can go.