Hacker News Reader

Comment by fasterik | Hacker News Reader

An alternative to journals would be to switch to the arXiv model everywhere: let anyone publish with a bare minimum of moderation, make papers explicitly versioned, and let peer review happen out in the open. Already for decades, the importance of a paper has been measured by citations, not publication in a prestigious journal.

View on HN

I think you still run into the problem that writers will vastly outnumber readers, so that risks turning the project into a write-only dumping ground. From there you have the same old discovery issues, where traditionally scientists relied on reputation as a first stage filter.

How do you build reputation in that environment?

Reputation is already a lot more about networking than a specific publishing system. Researchers get recognized by producing quality work and telling people about it in person and on the internet. Reputation spreads by word of mouth. I don't see that changing much in an open publishing world.

> How do you build reputation in that environment?

word of mouth and circle of trust that spread?

Verified predictions by 3rd parties.

A good science should focus on verified and verifiable predictions.

I think you missed the chicken and egg problem here: if you don’t have a good reputation, no one will read & verify your results. If 3rd party verification is the source of reputation, then how do you get started?

> if you don’t have a good reputation, no one will read & verify your results

No one will quote you if you don't have good reputation either.

> If 3rd party verification is the source of reputation, then how do you get started?

By surviving the check against the reality. Or doing 3rd party verification on other works.

No thanks. I have no interest in peer reviewing anything for free if it's going to be handed over to closed source AI companies. And before some facile comment about Elsevier comes along, no I don't review for them either and it's clearly not the same.

You're thinking in terms of the traditional peer review model. I'm imagining a more organic process where papers are scrutinized to the extent that they're considered important or promising. For example, how Grigori Perelman's papers on arXiv about the Poincaré conjecture were reviewed by peers. There's no assignment of individual reviewers in this model, it's a natural byproduct of researchers discussing and collaborating in public.

Grigori Perelman's papers were considered promising mostly because they were written by Perelman. When there are too many papers to read, the reputation of the authors becomes the most important signal of quality. Formal peer review tries to spread the attention a bit more evenly, but it doesn't scale too well.

On the one hand yes, Perelman was known within his subfield. On the other hand, I find it hard to believe that if some random person had published the same papers, they would have gone unnoticed, since as far as I understand it these were important results that would have been worth evaluating based on the titles and the abstracts.

Volume isn't really a problem going forward, at least in mathematics, since every proof can be accompanied by a Lean verification. Whether other disciplines can implement automated verification or quality assessment will depend on the details of the field.

The more famous the problem, the more reputation matters. There is no shortage of papers claiming to prove P vs. NP in either direction. Nobody is taking them seriously, as everyone has a strong prior that people trying to publish such results are cranks.

Mathematicians need to rethink what is the purpose and value of doing pure mathematical research in the future. Until know, they have mostly valued the creation and systematization of human knowledge. From that perspective, Lean proofs mostly increase confidence in the human knowledge. But they don't contribute directly to it, as a formal proof is unlikely to contain insights that are not present in the human proof.

Reply on news.ycombinator.com