Leaving might work with people who are intentionally being rude.

Most of the time, people aren't aware they're being rude, but will be offended if you try a passive-aggressive way of implying this is the case.