I've implemented a POC on exactly this and am working on something more sophisticated right now. Can I reach out to discuss more?
It must run locally / require no network requests. I can run on an M2 w 24GB or M3 with 36GB.
My email is in my profile here.