I used a non contact voltmeter, and had shut off the breaker to the outlet I was working on. Little did I know that the jackass that did some previous wiring in the house had run wires from a different breaker in to this box. It was done in such a way that I didn't fully realize it could have separate live.
My palm below my thumb touched the live and neutral and gave me a pretty solid shock.
I'll definitely test every single freaking wire in a box from now on. F people who try to play electrician without knowing what they are doing!