Safari is known to be troublesome when a webpage contains many HTML audio players. It can get extremely slow and unresponsive.
Every researcher I know in the audio ___domain uses Chrome for exactly that reason. The alternative would be not to use the standard HTML audio tag which would be ridiculous.