I think you're mixing up endianness. The way I understand it, your first paragraph actually describes little endian encoding. I understand it as "the little value (i.e., the insignificant value) at the end".
EDIT: In fact maybe I'm wrong, if you consider the lowest byte address the first line of an address label... now I'm confused, haha.