That explains the 5x speed increases huggingface mentioned for Mac using metal.