Wow. This is amazing! I'm not holding by breath for Mac OS support as Apple isn't very fond of Nvidia. I'm sure there will be clones in future for MacOs/IOS, Linux and Android.
Granted, powerful hardware is still required to run inference at acceptable speeds (or at all - I don't know the memory requirements).