Well the obvious response is then "can I conquer your land by force too?". No. Because there is a construction of "lawful property rights" that starts with the appropriation of land by force but protects the new owner from the same.
Well technically the land can still be appropriated by force, only you have to apply it against the entire system which enforces "lawful property rights"