True in general, but there is seriously little downside to using a low-latency kernel. Sometimes it even improves throughput, usually the effect is tiny either way.
I think most people just don't care or don't know that they care about responsiveness.