The interesting implication here is the stone seems to mark the 'official' border and the nobody but the farmer can move it back without engaging in some sort of bureaucratic process.
If it is in, presumably, French territory now, why can't some French resident roll it back?