There's other ways into NYC from NJ that aren't the train. There are many ferry options along the hudson, and nothern shore area has a commuter ferry that is 40 minutes to Wall St.
I live in NJ, and from 2006-2010 worked in WFC near Wall Street...While the ferry option is nice and pleasant, it used to cost about 2.5~3 times MORE expensive than the PATH train (the "subway' that connects both sides of the Hudson). Also, the duration of the commute gets cut down only about 1.5~2 minutes (as compared to when the PATH is running without delays). Overall, not really sustainable - neither in time nor money. Though, as a tourist, yeah, the ferry is nice for its views of the skyline. ;-)
I've used the ferry a handful of times to take my bike in, but it definitely caters to a very specific clientele. It's simply not worth it unless you live right there or work right where it lets off.
Yes, the strip of land from Jersey City to Edgewater is an exception in terms of travel time, but that doesn't apply to many NJ to NYC commuters.