As for it infringing on freedom 0, I don't understand how your logic wouldn't also apply for the GPL. I disagree that you cannot "use the software for any purpose" with the AGPL. You haven't given an example of you being restricted by it. If a user gave a copy of their program to another user they would have the exact same requirement (under the plain GPL). If you wanted to run a private copy of your modified program you just have to make it forbidden to connect to that interface.
Also, there's no reason you cannot just provide a link to a git repo for your modified project. Which means that you don't even have to modify your program to distribute its source code to users.