When you say "see the exact history of where the data came from", what does that mean?
When I publish the string "Dogs have two ears" on a blockchain, that notarizes that I published this string at a certain time or earlier. But how does it tell where the data comes from?
I should be able to give a better answer, here, but I’m not sure that I can. Not sure that this helps, but this is the non-technical overview currently on their site: https://vectorspacebio.science/technology/
The "dataset" is a string, right? A sequence of characters.
Like "Dogs have two ears".
But what does it mean when you say "know where the data came from"?
If someone publishes that string on a blockchain, you know they published it. Because they signed it. And you know when. Because the blockchain timesteamped it. Fine. But "where it came from"? What does that mean?
Those 1000 papers would be run through the data analysis pipeline to generate a “dataset” representing the relationships. For instance, a CSV file of the relationship information.
That dataset is what is hashed, and that hash is the “string” that is published on-chain.
It would be like if you had a bunch of papers about how many ears animals have, whether they have fur, where they’re from, etc, and you want to find out how those things relate to one-another. The info about ears and fur is the “data that changed” and the “dataset” is essentially vectors for how the information relates to each other. Then that dataset is hashed, etc, and that hash is what’s stored on chain. Then when another paper is added, the relationships csv changes, and that is re-hashed and published.
It’s hard to describe this without some jargon, just because of what we are discussing. I left another comment before with a diagram that might or might not help.
Why "1000 scientific papers"? Why not 500? 200? 17? 3? 2? How many are needed to make your point? Why "scientific"? Does it only work for "scientific" papers? Why "papers"? Does it not work for strings in general?
Same for "proteins", "underlying data", "data analysis pipeline" and all the other concepts you introduce.
If you comb through all of this and remove everything not necessary to explain the underlying idea, maybe you get to something and maybe not. I don't know.
Imagine we understood blockchains already and someone wants to explain the payment functionality of Bitcoin with a garden of wonderful terms like you do. "Thousands of virtual banks connected to millions of owners. Payments flowing through this massive global network instantly and nearly free, guaranteed by scientific cryptographic proof". It would tell us nothing.
What we need is:
With a blockchain, we can create an ordered list of messages like "I give coin 17 to Bob. Signed: Alice"
That explains everything we need to know to understand how payments are possible on top of a blockchain.
That's the type of statement I would dig for if you want to know if there is actually something useful about a technology.
I included a more basic answer in my last response that followed your concept of dogs with ears. Why wasn’t that abstraction simple enough to avoid this criticism?
This is about as simple as I can make this.
1. Collect source data 2. Run data analysis 3. Processed dataset is generated 4. Processed dataset is hashed 5. Hash is combined with the API wallet address and rehashed 6. That hash is stored on chain and with a transaction involving their token 7. Data from step 1 changes, repeat
Why 1000 papers? Because…I picked 1000? Sure, choose 10. Whatever. Does that really affect whether you can understand what I’m saying?
Why data analysis pipeline? Because the graphic that I sent you has its literal first step as “language modeling pipeline” and I was trying to avoid getting flamed for mentioning language modeling. https://ibb.co/5rBnTsv Substitute “analyze data” if you want to. But it’s silly that I can’t use the word “pipeline” on a technology forum.
Why underlying data? Because I need to differentiate between the raw, pre-processed data and the post-processed data, the latter of which is actually being hashed. I figure this was important since the whole point of this thread was how blockchain is being used.
Why proteins? Because it’s a biosciences company with a product called The Protein-Protein Interaction Network (PPIN) API, and that’s a common example they use when explaining what they do. From https://vectorspacebio.science/cmdb, A REST-based API which can be used to generate a multi-level graph network from a correlation matrix dataset. The graph network represents context-dependent known and hidden relationships between proteins, pathways, drug compounds and molecular sequences.
Did I have to choose proteins? I guess not. They have products to be used in financial markets as well that use the same technology. Technically this can be implemented in any domain. I just picked a particular one.
Why scientific papers and not just papers? Same response as above.
Not sure how much further we are going to get with this conversation, to be honest. But I’m trying to operate in good faith.
1. Collect source data
2. Run data analysis
3. Processed dataset is generated
4. Processed dataset is hashed
5. Hash is combined with the API wallet address and rehashed
6. That hash is stored on chain and with a transaction involving their token
7. Data from step 1 changes, repeat
The way I read this:
- A company created a dataset and updates it from time to time.
- For each update, they put a hash of the dataset on a blockchain.
I suppose update frequency doesn’t matter from the perspective of just conveying how it works, but it could be updated frequently. For instance, any time a paper is published, or if the customer provided a data stream, etc.
> Ok. And what is the use case? What would be different if they did not publish the hashes on a blockchain?
The idea of blockchain is “don’t trust, verify,” right? Imagine you’re a researcher and you’re using this company’s services. Having the hashes on-chain allows you to verify the integrity of the data over time. Having it on-chain removes attack vectors associated with e.g. a standard database. Similarly, all of Vectorspace’s tooling for various services benefit from the same assurances that the data is sound. So like I said initially: data provenance.
What would be the simplest example of "using this company’s services"? Maybe an API call like this?
GET /animals/dogs/ears/count
Now you know that the company claims that dogs have 2 ears.
How does the fact that they published a hash on a blockchain allow you to "verify" that statement?
At best, you can say "The company claims that dogs have 2 ears and they did so 3 months ago already", right?
But the hash does not help you verify the claim on how many ears a dog has.