Please note that in most environments Passenger now comes as a binary distribution so there is no need to recompile anymore.

Unless ofcourse you are using it together with other nginx modules, that's an unfortunate effect of nginx's module architecture I'm afraid.