The phrasing is misleading. The add-on cannot run without you present. In order to fetch the document without any formatting problems we needed to use ScriptService which causes this permissions prompt.
See related: https://code.google.com/p/google-apps-script-issues/issues/d...