Since we can't remove batteries I know a mylar Cheetos snack bag does the trick.

The toggles to turn off this feature (as well as Find my in general) do stop this.

That’s opt-in though.