I've been drinking good espresso for many years (locally and freshly roasted beans, good grinder and espresso machine, etc), then moved to aeropress and been sticking with americano for the last year. Now, I'm trying not to drink any coffee for a month to check if it's the reason I'm getting extremely anxious lately.
I've been down that road but have more or less convinced myself the coffee wasn't the problem. Although I don't drink _all_ that much. Coffee does seem to make it a bit harder to be self-aware, though .. like your energy levels are higher but they leave less time for the kind of boredom that causes you to have thoughts about stuff you've been avoiding thinking about.