Mosaic's MPT models are already supported in GGML: https://github.com/ggerganov/ggml

Here's MPT-30B running in 4-bit precision on CPU :) https://twitter.com/abacaj/status/1673133443339763712?s=20