From what I understand, once you accept that gravity isn't a force, the usual symmetry between the earth and the apple doesn't hold anymore.

The apple doesn't curve space-time as much as the earth does.