I don't think it's in the spec (because I don't see it implemented), but I also don't see any blocking issues regarding an extension to the spec to provide this (aside from the usual issues with "server-side" E2E and roaming/multi-device access)
Right now you could PGP encrypt what you post and only share your key with your intended audience, but that would seem to defeat the purpose of publishing activities to the open web.