If you haven't yet, you could put your HDMI devices on the quick access buttons (long press on the number buttons). I pretty much never use the home screen, despite using multiple HDMI devices and a bunch of streaming services.
Not only does this work wonders when the TV is already on, you can even configure QuickStart+ so that the quick access button actually turns on the TV (while switching to that input).
I don't have any buttons on my remote except home, Netflix, and Amazon Prime. If I accidentally press one, I have to go through the home screen and scroll through all the default apps to get back to my HDMI inputs.