HNHacker News
TopNewBestAskShowJobs

ArneBab

494 karma · joined August 17, 2012

[ my public key: https://keybase.io/arnebab; my proof: https://keybase.io/arnebab/sigs/iOQAz_dGJHtEoZqEiy1Xn1ig9dUNH_OFKqgQgJM-Lu4 ]
submissionscomments
ArneBab··on Ian Clarke explains the next generation of Freenet [video] (2023)
Check the prepared release news for the changes since last year: https://github.com/hyphanet/fred/releases/tag/build01498

Currently waiting for the new signing infrastructure for the Windows installer before turning the release to final.

Freenet 0.7.5 build 1498

This release resolves the last blocker for Freenet / Hyphanet 0.8 by providing an official Debian package. Additionally it optimizes the networking and data transfer core and provides many improvements for website authors and user experience.

Starting with this release, Freenet / Hyphanet has an official Debian package built automatically via github actions. This was the most important [high-impact-task][] and the last release blocker of version 0.8 in our [Roadmap][]. Big thanks go to DC!

With this finally realized, the next step is to get in contact with the many privacy focussed distributions which build on Debian to make `hyphanet-fred` available where it is most important. Once this is done, tools which build on Hyphanet — like FMS, but also jSite and tools from pyFreenet — can be packaged to work out of the box, using Hyphanet as an ordinary background service. That’s a step towards Hyphanet as decentralized, privacy-preserving communication backend for other applications.

Another step towards this is accepting the Schema hypha[net] to simplify writing browser extensions that forward hypha:-links to Hyphanet.

The networking layer was optimized significantly. Searching packet types is often stopped early and common or cheaper checks are done before less common or time-consuming checks. This gives significant reductions of CPU load, especially for very fast nodes.

Juiceman fixed a bug limiting MTU to 1280 where not needed.

And recently failed and data not found cooldown times were reduced to 5 minutes and 3 minutes, reducing one of the big annoyances when accessing a site quickly after upload.

On the data transfer layer, healing was optimized. After 1495 strongly increased the amount of healing to keep large files available for longer, 1498 specializes healing to keys close to the node location. This reduces healing per file, but improves privacy, because healing inserts are then more similar to forwarding — they mostly send data close to the nodes location — and it reduces the network load of healing, because the specialized healing inserts need fewer hops to reach the optimal storage location in the network.

In addition to these changes deep down, there are a number of directly visible improvements.

The plugins KeepAlive and Sharesite are updated (the latter now uses the new Night Zen Garden style). The UPnP2 plugin is now visible in simple mode. It can replace UPnP and should work better. On the flipside the Library plugin is moved to advanced plugins, because it does not work reliably enough.

The plugin list is easier to navigate by removing the defunct option to download plugins from the clearnet and by adding better styling. Downloading from the clearnet was an unnecessary privacy risk since we’ve been bundling essential plugins with the installer for a few years now.

The noderef for friend-to-friend connections is shown in simple mode again, because it is robust enough with the changes in recent years. This should remove a barrier to adding direct connections and enabling fully confidential messages between friends.

There are new configuration options to allow connecting via local services. That’s a step towards making it easy to add a second layer of security, for example confining connections to a local network. Thanks goes to s7r for these changes!

When bandwidth detection fails, the upload bandwidth now defaults to 160KiB/s. Also the NLM config is now disabled statically. This was a testing setup which could still be active in old nodes, but it would break connectivity nowadays.

The default bookmarks include the Opennet SeedNodes statistics, the generate media site to create decentralized streaming sites, and the high-impact-tasks. The bookmarks are also re-ordered to be a better match for newcomers. Starting category: first steps, clean spider, Index of Indexes. For the software category ordered by ease of use from fproxy.

For website authors, more CSS elements, selectors and combinators (`:checked`, `word-wrap: anywhere`, `focus-within`, `^=`, `$=`, `=`, `>`, `+`, `~`) and additional HTML elements (`summary`, `details`, `<meta name="Viewport"...>`) are available. This strongly expands the possibilities of websites authors in Hyphanet, because Javascript or webassembly are no viable options in an environment where a privacy breach could put people at risk. We’ve seen with Java applets, that untrusted code will always break out of its containment. The CSS improvements in contrast provide a safe way to enable limited interactivity.

Streaming support via m3u lists was improved to allow accessing segments of up to 200MiB.

And using `-1` as version in a USK now properly finds version `0`, if this is the only existing version.

There were a number of Java 21 fixes, including all our tests (thanks to Bombe!), and improvement to the github actions (thanks to AHOHNMYC).

In addition to that there was a lot of polish. Bert Massop and Veniamin Fernandes replaced our homegrown CurrentTimeUTC with modern Java options. Alex fixed the pronoun used in strings. Bombe added getters for all direct field access in the node. Hiina reduced logging level of store warnings so no unneeded backtraces are created for node with large stores and Juiceman updated code to use more modern structures.

Time-dependence of compressor selection was removed. This caused non-determinism for inserts and could cause keys to be non-reproducible on systems with faster or slower network.

And finally the new [exe signing workflow][] we built to fulfill the requirements of SignPath, our new windows installer signing provider for the upcoming releases, runs the [verify-build script][] on every release to ensure that the jar we release has actually been built from the sources. This provides a second safety net, in addition to anonymous users running the script and posting the results (thanks to all who did this — please keep it up, otherwise people have to fully trust github). The release is not yet byte-by-byte reproducible, because the jar MANIFEST defines among other info the exact java version used to compile it, and the java version available differs by distribution and time, so it would get harder over time to verify the build.

A special thanks goes to Bombe for many careful reviews!

[high-impact-task]: https://github.com/hyphanet/wiki/wiki/High-Impact-tasks [Roadmap]: https://github.com/hyphanet/wiki/wiki/Roadmap [exe signing workflow]: https://github.com/hyphanet/sign-windows-installer [verify-build script]: https://github.com/hyphanet/scripts/blob/master/verify-build

ArneBab··on A kernel update broke my stylus
So avoid that for giving lectures, I bought a refurbished laptop with Linux (Trisquel) pre-installed. In the past 5 years it did not give me trouble yet.
ArneBab··on A kernel update broke my stylus
Most email clients have powerful filtering options. And since this is the tool of the trade for kernel developers, they use this power. If you did work on a tool that used an email list as bugtracker, you’d likely have a well-working setup for that.

And when you have setup your email client, it beats github issues in time efficiency any day.

ArneBab··on A kernel update broke my stylus
The tablet works well as mouse in absolute mode, too. You just need to get used to the different way of positioning (with the tablet as a small representation of the screen).

My kids even prefer that with a big (and pretty old) wacom tablet.

ArneBab··on Freenet Renamed to Hyphanet
By moving the decision what is accessed out from the storage layer and into the communication layer which enables fully decentralized blocking.

You’re not responsible for the encrypted chunks that your node serves just like you’re not responsible for the money your ISP pays for the internet backbone.

But you are responsible for the people you recommend, so when you get information about something illegal, you are responsible to block them in your communication tool.

ArneBab··on Freenet Renamed to Hyphanet
There are around 3000 running nodes at any given moment.

I run one and Sone (social networking) and FMS (forums) are among my primary means of communication.

I use it to stream the creativecommons web series bloodspell because it is far too little known despite its awesomeness and this proves that streaming a series over Freenet / Hyphanet works.

Also Freesites these days aren’t slower than newspaper sites anymore — though part of the reason is that newspapers are crippled with advertisements and surveillance misfeatures. A well-made website on the clearnet is faster, but the typical site on Freenet / Hyphanet is no longer slower than the typical (ad-encumbered, heavy-JS-framework-loading) site on the clearnet.

As a user put it nicely: Freenet / Hyphanet: the internet that should have been.

ArneBab··on Freenet Renamed to Hyphanet
Are you aware that besides websites the original Freenet / Hyphanet of today provides convenient media-streaming, social networking, hidden pseudonymous email, forums, and interactive chat?

That its spam-control is significantly faster than earlier thanks to improvements for a university thesis?

That it’s performance has increased a lot due to improvements in the networking layer?

ArneBab··on Freenet Renamed to Hyphanet
I remember the Gnutella vs. Gnutella 2 debacle.

That was pretty and crippled Gnutella quite badly — even though Gnutella 2 actually had similar goals as Gnutella.

That’s the historical precedent. You can learn from it and avoid such steps, or you can ignore it.

Keep in mind that Locutus does not have privacy as a goal: if it harms the original Freenet like "Gnutella 2" harmed Gnutella, then privacy on the web suffers.

ArneBab··on Show HN: Freenet 2023, a drop-in decentralized replacement for the web
Sounds like YaCy?
ArneBab··on Show HN: Freenet 2023, a drop-in decentralized replacement for the web
If you don’t want more privacy than what the browser gives by default, you don’t need content sanitizers.
ArneBab··on Freenet build 1495: new user experience and performance
There is a lot of personal opinion nowadays — along with forums and microblogging and people discussing philosophical arguments in IRC-over-Freenet (FLIP).

You’ll wait up to 30s¹ for a 100k html file nowadays. 1 minute for a 2 MiB website.

¹: if you have at least 10 peers. If you try to run with the lowest possible specs (5 peers), you won’t get a good experience, but with 10 peers it works pretty well (and the Japanese with their awesome connection speeds actually get 60 peers).

Also see https://news.ycombinator.com/item?id=34180729

ArneBab··on Freenet build 1495: new user experience and performance
That’s why we need to make it the default that people use Tor whenever they search for anything connected to health or politics — topics that others might want to discriminate against you on.

Women looking for abortions in the US just learned the hard way why this is an essential practice.

Recommended watching: The NSA surveillance doesn’t scale — Constanze Kurz at Euro Python 2014: https://archive.org/details/EuroPython_2014_kSFzmDYc

ArneBab··on Freenet build 1495: new user experience and performance
Gnutella moved from broadcast to dynamically structured search early on (in version 0.6, 2002). See https://rfc-gnutella.sourceforge.net/src/rfc-0_6-draft.html

Including decentralized download via HTTP using just three added headers and Tiger Tree Hash Exchange: https://rfc-gnutella.sourceforge.net/src/Partial_File_Sharin...

Scalability was limited to global search in around 5 million nodes (with the network spanning 40 million people at its peak), though, due to restrictions in the number of TCP connections Windows (private edition) supported.

ArneBab··on Freenet build 1495: new user experience and performance
That’s where we don’t want to end up, because they actually have on-device spying on mobile devices via the IME (which the Freenet First Start wizard warns about to avoid giving a false sense of security).

Something like the planned ChatControl,¹ but through a non-trustworthy third party most people have installed for convenience.

Nothing can fully protect against that.

¹: https://chatcontrol.eu

ArneBab··on Freenet build 1495: new user experience and performance
That’s not quite true.

Freenet protects communication — content in flow. Somewhat larger files that are not accessed automatically disappear from Freenet after a short while.

Tor protects your connection to another computer.

The stated usecases are excellent examples for usage of Freenet: information for transgender people or about abortions. Even accessing such information can get you in danger nowadays.

And a site accessed via Tor can more easily be compromised (to get your identity by tracking information from your OS or similar) or taken down (so the information is gone).

ArneBab··on Freenet build 1495: new user experience and performance
These days you have to go actively searching to find such on Freenet. And as journalists proved multiple times¹, if you do go searching, you’ll find a lot more of it in the clearnet via forums accessible with Tor than in Freenet.

And for the highest security in Freenet (the friend-to-friend mode), you need to have friends whom you trust not to go to lengths to spy on you — friends would be able to run statistical attacks if you transmit large amounts of known content. And such trusted friends are what people who want to access child abuse content do not have.

¹: Example (in German): https://www.youtube.com/watch?v=iItLpwkQMUQ

ArneBab··on Freenet build 1495: new user experience and performance
Tor gives you an anonymous connection to some server. Stuff that’s not linked to is still available to the server admin.

Freenet provides an anonymous, encrypted, and distributed cache that does not rely on the security of any one server. Stuff that’s not linked to could just as well not exist, because no one can access it.

ArneBab··on Freenet build 1495: new user experience and performance
Just having a Freenet connection does not get a warrant — though there are researchers who use some fishy statistics which may be reason not to run a very fast node in the US (because running a fast node provably causes false positives in their statistics).

For some more details, see https://freenetproject.org/the-discredited-levine-2017-appro... and the links therein.

ArneBab··on Freenet build 1495: new user experience and performance
Freenet has a different concept than MaidSAFE: While MaidSAFE (as it was when I last looked into it — a few years ago) is a hosting and application platform, the focus of Freenet is to be the technical component for censorship resistance. Everything it provides comes from this — even the recently added video and Android support (because Black Lives Matter showed clearly that the information that people need to share the most is video content nowadays).

Therefore the overarching design goal of freenet is to make censorship as hard as technically possible. That’s the reason for - providing anonymity (else you could be threatened with repercussions - as seen in the case of the wikileaks informer from the army in the USA), - building it as free software network (else you could just shut down the central website, as people tried with wikileaks), - providing safe pseudonyms and caching of the content on all participating nodes (else people could censor by spamming or overloading nodes), - including good moderation tools (otherwise people could censor by just "flooding the zone with shit"), and even - the darknet mode and enhancements in usability (else freenet could be stopped by just prosecuting everyone who uses it, or it would reach too few people to be able to counter censorship in the clearnet).

One core difference between MaidSAFE is that Freenet provides communication. Content in Freenet stays accessible while people access it, without tracking accesses: When you upload something, you can imagine that a clock starts ticking. After a while (depending on file size) the content is no longer accessible. But if someone accesses it, their node "heals" that content, which resets that clock.

Also Freenet enables people to connect purely to their friends, so there’s no central point of failure or detection.

I once did a comparison to other projects for a funding proposal (that did not succeed, though) which should still give you an idea about the difference between Freenet and other systems: http://www.draketo.de/proj/freenet-funding/#sec-9

ArneBab··on We Are Changing the License for Akka
I think people don’t take the license of projects they use seriously. The license allows such relicensing.

Use a copyleft-licensed project with outside contributors if you want the project to stay free.

ArneBab··on We Are Changing the License for Akka
it’s basically a cc by-nc? https://www.draketo.de/light/english/politics/free-culture-d...

NC covered works trick people into investing in a dead end.

They can do that, for sure. It is legal and I don’t see reason to complain. You cannot trust a project to stay free if it is licensed without copyleft or requesting that you assign them your code without guaranteeing that it stays free.

ArneBab··on Try Stable Diffusion's Img2Img Mode
python optimizedSD/optimized_txt2img.py --device cpu --precision full --prompt "…" --H 512 --W 512 --n_iter 1 --n_samples 1 --ddim_steps 50
ArneBab··on Wisp: Whitespace to Lisp
I usually do the alignment with tab: my Emacs wisp-mode knows the indentation levels in use in the file, so it’s just shift-tab to go back to the previous scope and tab to nest more deeply.

One observation I made is that wrapping an expression around several lines is often less intrusive, because I can simply insert a line before the block that uses only half the indentation.

ArneBab··on Wisp: Whitespace to Lisp
You can do that in wisp: Inside parentheses (and strings), whitespace processing is halted.

define : proc

  display (string-append "foo"

    "bar" (format #f "foo~a" 2)

     ) ; is valid wisp
(it would be valid wisp without the indentation in the parentheses, but it would look weird)

(empty lines added to prevent hn from stripping newlines)

ArneBab··on Wisp: Whitespace to Lisp
There’s also a wisp-derivative for Racket called Wraith: https://github.com/cwebber/racket2-rfcs/blob/wraith/wraith/w...
ArneBab··on Wisp: Whitespace to Lisp
A description like JSON / YAML with YAML as proper superset is close, yes, since you can embed arbitrary parenthesized Scheme in SRFI-110 (readable), SRFI-119 (wisp) and SRFI-49.
ArneBab··on Wisp: Whitespace to Lisp
Do you mean highlighting like this? https://www.draketo.de/software/wisp-mode-highlighting-seman...

Many parts of structural editing (but not all) become simple indentation shifting with indentation-sensitive languages.

ArneBab··on Wisp: Whitespace to Lisp
Wisp was developed alongside SRFI-110 for a while and branched to SRFI-119[1], because SRFI-110 got more and more complex to improve edge cases while the focus of wisp is to preserve the simplicity of lisp. For more details, see the history part on the website[2].

The background of calling it Python-like is that this is the motivation behind starting Wisp:

    » I love the syntax of Python, but crave the simplicity and power of Lisp.«
[1]: https://srfi.schemers.org/srfi-119/srfi-119.html [2]: https://www.draketo.de/software/wisp#sec-5
ArneBab··on Wisp: Whitespace to Lisp
Except that wisp is not abandoned. See for example dryads-wake for a practical use that provides an embedded DSL for game dialogue that reads like a typical theatre script: https://hg.sr.ht/~arnebab/dryads-wake
ArneBab··on Freenet 1494 released: streaming, config, security, windows, Debian, tooling
Thank you!
← PreviousPage 2 of 8Next →