Have you tried ArchiveBox since v0.9 was released? v0.9 was basically a complete rewrite with a new archiving engine, and it ships with ArchiveWebPage built-in as one of its plugins now.
As of the latest v0.9.77 it's now tested to be able to handle 2 million snapshots / 2TB on a 4CPU server, archiving @ 1 URL/min consistently while serving all the web UIs @ ~100ms. Also has automatic importing from social media, google docs, notion, canva, figma, and a growing list of sites with self-healing AI scripts & cookie sync from your browser so it doesn't need as much babysitting.