I don't know how VLC does it, but the asoftclip ffmpeg filter probably does what you want.