Karakeep already does what this is trying to do and it is open source

https://github.com/karakeep-app/karakeep

~30k Github stars