This is one of the things that is oft repeated by my vector disease colleagues -- your infection may not be caused by the tick you found, but by the tick you didn't.
From what I understand, you're spot on with your last note. Larval stage can be extremely hard to see even when fully engorged. Adult-stage ticks (at least Deer Ticks) are the size of a large grain of cooked brown rice. I've seen fully engorged nymph-stage that rival the size of a grape...
One other I found crawling up my white tshirt. Good reminder to wear light colored clothes when you’re out where ticks are.