As A Fire Upon the Deep is one of my favorite books (it's been a while since I've read it- my copy is currently on tour), I'd like to chime in and say I remember this reference, but I believe it's in A Deepness In the Sky, which goes more into Pham's backstory. It's definitely one of these two books though.