That's OK, I'm quite frugal, don't mind travelling with public transport. Even if you save 50% of that it's already enough for me.

So you take NJ Transit into Port Authority like everyone else does.

Yes it will, easily. Just not in Manhattan.