No, you are not conveying the software to people who merely interact with it over the network. From the text of AGPL itself:
AGPL> To "convey" a work means any kind of propagation that enables other parties to make or receive copies. Mere interaction with a user through a computer network, with no transfer of a copy, is not conveying.
> As for it infringing on freedom 0, I don't understand how your logic wouldn't also apply for the GPL. I disagree that you cannot "use the software for any purpose" with the AGPL.
Being able to "use the software for any purpose" is not sufficient to satisfy freedom 0. As the FSF explains:
FSF> The freedom to run the program means the freedom for any kind of person or organization to use it on any kind of computer system, for any kind of overall job and purpose, without being required to communicate about it with the developer or any other specific entity.
Note that you have to be able to use it for any purpose without being required to communicate about it with the developer or any other specific entity. If my purpose with the program from my example is to play chess from my computer with remote people, I am not able to do that under AGPL unless I communicate my modifications to them.