4,137 karma · joined December 29, 2013
It's not hypocrisy when different people do different things.
Yes, however it’s a different format from standard fp16, it trades precision for greater dynamic range.
FWIW I never got it to work and did not dig into it much.
Edit: the settings is "GGML_CUDA_ENABLE_UNIFIED_MEMORY=1"... useful if you have unified memory, very slow if you do not.
This sort of thing used to bother me back when I took Windows seriously.
[edit] I did a little reading and it sounds like the company does not query the government with your ID. You get the cryptographic ID from the government, and present it to a company who is able to verify its validity directly. My source is mostly this: https://www.eff.org/deeplinks/2025/04/age-verification-europ...