Integration with candle is already available! https://github.com/huggingface/candle/pull/3934/