Maybe there is something I don't get, but N ^ 1/5 looks polynomial to me. Even quite small polynome power!
The convention is to let N be the number to be factored, in which case log_2(N) is the input length. Hence, an algorithm that runs in time "polynomial (in the input length)" would have to run in time log(N)^k for some k.