The problem is not even a land grab per se (even though it does cause problems). The problem is that the grabbing party, having succeeded, does not stop, and develops an approach to international affairs that ends up being problematic in the long term. Germany in 1939 did not limit itself to acquiring Alsace and Lorraine, and even to grabbing most of Poland (along with its then-ally USSR), and even to grabbing most of France. Same for any historical empire. (The US in this regard is slightly different, e.g. it did not directly grab Texas, and bought large parts of California. Having grabbed the entire width of the continent, there remained little desire to grab the inhospitable south or north.)
Your logic may work with e.g. Taiwan: I don't think China would go on an expansionist rampage once it grabs Taiwan (or "returns", some would say). Should the US be just okay with that?