I think the point was that people with mortgages will opt into lower interest rates but will clearly not opt into higher rates. (Assuming the interest savings is greater than the refinance cost.)
I'm not sure why you bring up the amortization schedule since since you definitely save on the overall interest side of the mortgage. Put another way, if you get the lower interest rate and keep paying the same monthly payment you were paying before, you'll pay everything off faster.