I do this, and more people should. People on huge multi-user instances are completely missing the point of federation.

The downsides are the usual sysadmin stuff that comes with running servers for anything. People also get excited about the instance-local timelines on multi-user instances, but again, that's completely missing the point.