The "pass" is a catch-all for many things[1], including "rejecting a premise". It's non-obvious in the current interface, but there's room for coaching/learning how to engage with "complex/mixed" statements. For example, statements you encounter that conflict with your own emotional or factual sensibilities, which you're reluctant to respond to in a simple way (with agree/disagree). In this case, users can just "pass" on that statement, and immediately go below and submit a new "corrected" statement, or alternatively divide that one statement into a few separate ones, that can be reacted to more authentically.
That way, you're not forced to weigh in on things you find to be leading statements or overly simplistic. And the pool of statements for everyone becomes ever-more-nuanced through these sorts of interactions, and the map of the sentimental landscape becomes more high-resolution :)
With that said:
> How much value does a consensus system like this truly have in finding the truth of a subject matter
There's maybe some things to hash out here. If the value of consensus is seen as finding a "truth", then yes, I agree this tool is suspect for that. But if the value of consensus is simply finding enough agreement (on feelings/facts/whatever) to take a step forward together, then maybe it can survive truth shifting under our feet a bit. What matters is whether we maintain commitment to moving in some direction together. And my experience is that Polis creates the stability and trust required for this.
Unlike the hyper-division fostered by social media platforms, Polis helps build stable common ground to stand on. It can be used to elevate and incentivize people who do the work of offering bridging (aka shared) sentiments. Other tools don't do this. My mental model is that the availability of these bridges in the opinion space, this stabilizes middle ground on which long-form deliberations can take place. [1]
> might be used as a tool by people with bad intentions to gather data about what the population superficially thinks and then be able to shape your media campaign
YES. This is a huge concern to not just Polis' creators, but many who work around big data. The capacity for abuse or manipulation is huge. My personal hope is that we can all build tooling like this together, to make us as a population legible to ourselves (symmetric, self-knowledge), rather than data simply making us legible to powerful actors via asymmetric knowledge (which is what's currently happening). This is why imho tools like Polis should be run openly by governments or other trusted partners (journalists). Cryptographic and data trusts should certainly play a role in future iterations.
This whole effort needs people thinking about safeguards in the same way that those designing/maintaining a democracy think about safeguards. imho the process of running these processes must [eventually] be comparably sacred to those of running elections and parliaments.
I can offer a specific case study with data, that deals with the discovery of the specific values of a specific population in the context of highly contested issue that has played out over a multi-decade period:
A debrief: https://pep.org.nz/2020/12/01/doc-tries-to-restore-e-democra...
The professional facilitators who work at nation scale in NZ: https://pep.org.nz/
The convo: https://www.scoop.co.nz/stories/HL1908/S00014/scoop-hivemind...
The reporting: https://www.scoop.co.nz/stories/PO1911/S00063/biodiversity-h...
Raw data: https://github.com/compdemocracy/openData/tree/master/scoop-...
Direct link to PEP's report to the Ministry of Conservation: https://img.scoop.co.nz/media/pdfs/1911/Biodiversity_HiveMin...
This is an ideal use case, but it is encouraging to us (and has motivated me over the course of the past decade) that given some combination of factors, there can be real progress, and while yes, it takes a bit of work, we do spend an enormous amount of time and money on worse outcomes than this. So, we can "save one starfish" https://raycenter.wp.drake.edu/2018/06/29/the-starfish-story... and put some lights on the horizon of other possible systems, should we inspire some millions, then tens of millions, then hundreds of millions to be spent on other political activities than driving wedges.
https://github.com/compdemocracy/openData/tree/master/scoop-...
If you take a look at the comments file, you can judge whether the system has been successful at getting people to submit a single idea at a time for people to agree and disagree on. My assessment is: mostly yes, sometimes there are still multiple ideas in 140 characters.
The system encourages the decomposition of ideas, so that we can identify which factors may be ignorable and which are significant to our purposes (consensus/disagreement/differentation).