There is a TeX distribution that does what you say, TinyTeX. For some reason it is obscure and only really used by R and R Studio users. That may be because it is used to render R Markdown documents to pdf.