They pretty much already offer this with outposts (its technically their hardware but its on your premises).

By "self-hosted" you still mean still running on AWS hardware? I don't understand. Why would anybody pay EBS rates instead of S3 rates, to get data stored in the same place by the same people?