I believe referring to it should be in the repository along with code, versioned, and sycned with the repository - like travis.yml. I actually think he/she made that pretty clear with the use case of referring to previous commits and previous build steps. Most non clicknext developers will forget the extra step of uploading it in the web ui, and/or won't care to version the microsftvisualstudioteamfoundationservices.json seperately