> How far down does this apply? E.g., do amino acids come basically for free in the same way?
Broadly, I think it is fair to say that many molecules that we associate with biological processes (e.g. amino acids, nucleotides, simple alcohols, etc.) do come "for free" in the sense that there are known pathways for these molecules to be produced in the absence of living organisms. The Miller-Urey experiment is probably the most well-known proof of concept of this idea, though it's debated how well the experimental conditions correspond with "the real world."
> ... [W]hat's the bootstrapping process like, and how random is it?
If I understand you correctly, here you're asking "what does it take to get from prebiotic organic molecules to living organisms?" And that is a fascinating question that has, to my mind, several possible answers, though ultimately I think the answer is "we don't know."
One very suggestive paper I read describes the bootstrapping process as a "surface metabolism" [1] that succeeds through several epochs before eventually producing free-floating lipid-membrane-enclosed micelles containing complex organic molecules and a rudimentary metabolism - i.e. protocells.
However, the IIRC paper falls short of explaining how these protocells can then start to independently reproduce. One hypothesis I recall from David Deamer is that hydration/dehydration cycles in shallow pools promote complex organization of simpler protomolecules into structures we typically associate with living organisms [2]; in other words, given the protobiomolecules mentioned above, certain environmental conditions encourage [proto]cell formation.
So, to answer your question (I think), there are many good candidates for the "bootstrapping process" and while there is randomness involved, it turns out that certain environmental conditions that were present on the early Earth (as well as currently!) tended to promote complex molecular formation.
> How many steps do you have to take from self replication to functional cells?
Not many; I would say that if you have something that looks like a cell and reproduces itself, it's a "functional cell." Personally, I think from that point we are at an, if not the, "origin of life," and understand in broad strokes "what happens next" - ever-more-refined single-celled organisms, multi-cell aggregates becoming "true" multi-celled organisms, and so on.
Let me know if you're curious about any other aspect of this topic and I'll try to provide more info!
[1] https://www.ncbi.nlm.nih.gov/labs/pmc/articles/PMC373159/