I've heard meditation described as "motionless ju-jitsu with yourself". In the absence of any obstacle, the only opponent is you, but by definition you are equal in strength to yourself. So meditation can devolve into a heated evenly-matched contest of wills, which is extremely draining.
It certainly shouldn't. Your aim is just to keep bringing your attention back to the object of attention. Each time you do that is a success, so feel pleased with yourself at that point.
Fighting is a bad habit that will send you down a blind alleyway in meditation. There should be no striving, no effort, just gentle persistence.
Oh man I love that description! It makes me think how exercise is like a contest against physical limits, which are knowable. Hard work leads to heavier lifts or longer runs. But when you kick your own ass in meditation, the limits are more ambiguous and progress isn't so linear.