Yeah, exactly what I'm moving towards. I've also started using the mdnotes plugin [0] to extract the annotations to markdown if I desire.

[0] - https://github.com/argenos/zotero-mdnotes