Nevertheless, I remember asking him what was it like to actually work on the project. He said that it was far less Hollywood-esque than many would imagine -- at least for him. He was just given math/engineering problems and was asked to solve them with no context. He never knew what he was truly working on, why he was working on these problems, etc.. The work was pretty isolating and contact was with others was pretty minimal. I do know that he met both Von Neumann and Oppenheimer on at least one occasion which is pretty awesome.
I wish I could find some records, but I do not even know where to look.