If the contributor is not interested in having the change merged then yes. But there might be good reasons for the contributor to have the changed maintained by the project maintainer, so many will choose to make the requested improvements (was in this position multiple times).