There are low-bit networks as well: https://arxiv.org/abs/1603.05279

That technology is now a spinoff of AI2 and UW: https://www.xnor.ai/