IANAL but the SD license is for the model weights and using them. As long as you're not redistributing the weights, I think you're good to use the MIT license.

Thanks for adding the license, very appreciated! This makes me want to take it for a spin much more!