103 karma · joined October 17, 2014
Makes perfect sense to me, and I would like to point you to the technology and ecosystem of "nanopublications": https://nanopub.net/
In a nutshell, nanopublications provide a decentralized infrastructure like Mastodon, but with focus on redundantly storing open data rather than on user ownership of personal data. Moreover nanopublications are basically snippets of knowledge graphs, so they resemble database entries and can be queried as such.
Happy to elaborate if this is of interest.
Thanks for your comments. First off: yes, most (perhaps all) of the applied methods are not novel, some of them have been around for a long time. We only claim novelty on how these existing methods are combined to solve the problem of data availability and integrity on the web.
Yes, the magnet URI scheme is highly related, and we probably should have referred to it in one way or another. However, there are crucial features that magnet links do not provide (as far as I know): you cannot generate a hash that represents content on a more abstract level than byte sequences (MIME types by themselves don't solve that problem), and you can also not have self-references. All of the features from our list of requirements are supported by some approaches, but (to our knowledge) no approach supports all of them at the same time.
In terms of search engines caching research data, I agree! We shouldn't trust existing providers too much but build a dedicated decentralized infrastructure for scientific purposes (this is what I am working on now).
I am sure the performance measures can be improved (incremental cryptography might allow us to get rid of sorting altogether). The shape of the curve is however not much affected by the fact whether the statements are already sorted or not (they are not sorted for TransformRdf and TransformLargeRdf!).
I hope this clarifies some things.