One way to look at it is that the highest bit is negative instead of positive. So in an unsigned 8-bit integer, the highest bit is worth 128. In a signed integer, it's worth -128.
> If the sign bit is zero, it shall not affect the resulting value. If the sign bit is one, it has value −(2^{N−1}).
[1] https://www.open-std.org/jtc1/sc22/wg14/www/docs/n3096.pdf
So it's all the same for bits [0-6], except for a -128 offset. Awesome!