Absolutely doable and it's a fun exercise. Mastodon is probably overkill for a single-user instance, there are other ActivityPub services that do not need Postgres+Redis+Ruby etc (pleroma, microblog...).
ps: as I found out while setting up my own server, diaspora is its own thing, it can't federate with ActivityPub services.