Cloning a template is IO-heavy. You can speed it up further by putting postgres on a ramdisk.
https://www.postgresql.org/docs/current/wal-async-commit.htm...
https://github.com/peterldowns/pgtestdb#how-do-i-make-it-go-...
I'd just say that a nice thing about it on disk (even if you disable fsync) is that in case of a failing test, you can examine the post-run state which is occasionally extremely valuable.