Hacker News Reader

Comment by DougN7 | Hacker News Reader

I'm having a hard time imagining this at scale.

I have a few thousand web pages on my site, blog posts, etc. Most of it won't be seen in any given day. So I have to pin it as it's realistically unlikely anyone else will. Not much different from today. This probably describes 90% of web content out there, where a single node is all that is keeping that content alive.

Now imagine something slightly more popular than my website. Maybe a particular Medium article. If it's two years old, it's unlikely to be getting any hits at this point, though it might have been popular at one time. So again, Medium has to pin it (or maybe the author would). Popular stuff would stay floating around while it's being viewed.

It's almost a dynamic CDN/torrent which could help with bandwidth, but I don't see any advantage for persistence in most cases.

View on HN

I think the advantage is that it's easier for _anyone_ to be able to keep a site/file alive without having to implement an archive.org style of rewriting all the URLs/links. If you want, you could pin that medium article you talk about and now even if the medium node(s) decide its no longer worth pinning, you've still got it pinned so it's accessible to anyone at the expected "location".

Similarly, this makes take-downs harder. It's no longer one node/machine hosting a file, but as many nodes as who find it valuable.

If users never pinned anything, you'd be correct, it would be basically the same as the current internet, with one organization maintaining everything. But IPFS gives you the ability to change that.

Thank you for that perspective - that makes sense. I hope there is an easy way to pin an entire site and not page-by-page so, for example, a full documentation set could be kept.

Yes, content on IPFS is represented as a Merkle tree so if you pin the top of the tree it will traverse down and recursively pin all of the subtrees as well. (You can, of course, pin a subtree explicitly if there's a only certain part you want.)

Maybe you'll find an article interesting and want to pin it yourself. Maybe you yourself will link to it and want to pin it for that purpose. Maybe someone else will link to a very influential article you wrote and that will make it stay.

Overall, it's a subset of the availability of a single server, plus the page always stays at the same "place" and never moves.

>Maybe you yourself will link to it and want to pin it for that purpose.

This is an important point. If you pin all the content you link to, the links on your site will never break so long as your node stays up.

Which essentially means you node is now a web server with all the responsibilities that entails (keep backups, always connected, etc). It feels fragile - I can't imagine pinning everything I ever read (or think might possibly be important some day).

What about all the .EXEs (games, etc) and SDKs I download? I'll bet over the past 10 years I've downloaded and viewed a few hundred GBs (or more) of content.

If I ever want to see anything again, I have to pin (cache it locally). I could do _that_ (cache locally) with today's web.

I like the idea. But just don't see it working well at scale.

you need to review the technology if you think ipfs is more fragile and needs data nodes to always be up.

you need one data node up. You can have as many as you want.

if nobody wants to keep the old exes, they'll be lost forever. ipfs was never meant to keep everything forever. Its meant to guarantee you that the file you're viewing (if it still exists) is the same one that was published under this hash. With no regard as to the source of the file. It could be shared with you by your neighbor or the original uploader. And, if you see value in the content, you can also share it with others by pinning it.

its essentially bittorrent as a filesystem. as long as nodes exists, the files will be available.

we built a little tool for organizations to share their "pin lists", so hackerspaces could back up each other's content https://github.com/c-base/ipfs-ringpin

The difference is that if you pay someone to host this site for you you are paying for bandwidth, DNS registration, and disk space. One DDOS attack could mean the end of your project.

With this kind of system the idea is that the cost difference between unpopular content and popular content isn't so pronounced. You might have to pay a little more up front, but there are fewer surprises in your bill.

Reply on news.ycombinator.com