For LDA you'll need to understand Dirichlet processes, I find the introduction by Frigyik et al. [2] to be excellent for that. You may need to read A Measure Theory Tutorial (Measure Theory for Dummies) by Gupta [3] before. Finally, I put there the two most influential LDA papers to me: [4] and then [5].
[1] http://www.inference.phy.cam.ac.uk/mackay/itila/book.html
[2] http://www.ee.washington.edu/research/guptalab/publications/...
[3] https://www.ee.washington.edu/techsite/papers/documents/UWEE...
[4] http://www.psychology.adelaide.edu.au/personalpages/staff/si...
[5] http://videolectures.net/site/normal_dl/tag=83534/nips2010_1...