Yes.
With a coastline, the closer you measure, the more length-increasing features you observe, causing the measured length to diverge.
Rivers have a finite width, so once the distance between your measurements is smaller than the width of the river, the measured length will converge to the true length.