Is it downloading the whole Youtube video just to pull out the audio? Why not just download the audio to begin with?
251 webm audio only DASH audio 143k , opus @160k, 78.96MiB
Then if I run youtube-dl -f 251 -g https://www.youtube.com/watch?v=r_fxB6yrDVo then I get this horrible URL: https://r1---sn-hxugvj5nu-cvnl.googlevideo.com/videoplayback...
However if I wget "[horrible_url]" -O audio, it still takes forever to download, so I guess rate-limiting might be the issue. But if download time is the problem, you could have one server that just downloads the data slowly to S3 and then kicks off the lambda job on the completed file.