My personal experience is that having taken Amtrak from NYC a huge number of times, it's never been meaningfully delayed leaving Penn Station. But that it will get delayed en route, as the train comes to a halt and the conductor announces we're waiting for a freight train. We wait for 10 or 15 minutes, the freight train takes a couple minutes to whiz by, and then we start moving again.
So I don't know what priority Amtrak has on paper, but in reality Amtrak trains that leave on time are delayed by freight.
So much so that for my return trip where I catch a train that's already been en route for 8+ hours, it's virtually always 30-90 minutes late.