HNHacker News
TopNewBestAskShowJobs

rarrrrrr

1,732 karma · joined November 22, 2008

I'm Alan Fairless

I'm a hacker, software engineer, and repeat-offender entrepreneur known for building security focused software systems.

I recently founded Transportant which helps K12 school systems keep students safe by making their school buses smarter (hardware & software.)

Previously I cofounded SpiderOak in 2006. The approach to "No Knowledge" end-to-end encrypted products and effective information security was endorsed by famous hacker Kevin Mitnick, NSA whistleblower Edward Snowden, and featured in the New York Times, Wall Street Journal, The Guardian, Wired, and many others. Our products have been used by millions of people, various governments and large corporations around the world.

You can reach me via yc at alanfairless dot com.

submissionscomments
rarrrrrr··on Ask HN: Is anyone using Microsoft Teams?
Microsoft is smart to build their own Outlook killer, and they certainly succeeded in freaking Slack out[1]. We (SpiderOak) evaluated teams as competitive research when building Semaphor [2] (our own end-to-end encrypted alternative to Slack/HipChat.)

I found Teams to be a credible offering. It's shortcomings are mostly about being very new (e.g. no linux client yet, some unpolished UI associated with window resizing.) The O365 integration is nice. The client seems to be built using Electron and TypeScript, and if the pace of development maintains I expect it will be a serious threat to Slack. Of course Slack and Teams require trusting the vendor with your unencrypted content.

[1] https://spideroak.com/articles/slacks-morning-after

[2] https://spideroak.com/solutions/semaphor/business/tour

rarrrrrr··on SpiderOakONE – Zero Knowledge Cloud Storage
SpiderOak can backup and sync arbitrary folders (including external drives, network volumes, etc.) So one migration path is just to select the Dropbox folder for backup by SpiderOak. (Or just move data from Dropbox folder to the SpiderOak Hive folder.)
rarrrrrr··on SpiderOakONE – Zero Knowledge Cloud Storage
Thank you for your interest in SpiderOak and valuing work to improve the choices available that preserve privacy.

For what it's worth, everything we've built since 2008 has published source code. Most recently that's Semaphor[1], which is written in Go and React.

I think it's very important that products have what Zooko calls an "economic feedback loop" to be successful. As just one example, volunteer projects rarely have staff that do the grinding but necessary work of testing that each release works well on every version of all support operating systems and platforms, because it isn't fun. I think this is why although some teams publish their client source code, very few service providers publish their server source code. It would make it too easy for competitors to emerge and undercut on price while giving little back (the biggest cost is the often the development work itself.)

That said, we've been in business for 10 years and are not going away! Thanks for your feedback.

[1] https://spideroak.com/solutions/semaphor/business/tour

rarrrrrr··on SpiderOakONE – Zero Knowledge Cloud Storage
Great question. The database work is all done client side.

Here's an explanation of the architecture I wrote in 2009: https://spideroak.com/articles/why--how-spideroak-architectu...

rarrrrrr··on SpiderOakONE – Zero Knowledge Cloud Storage
Thanks for asking! I'm really excited about a ZK note app!

We haven't yet determined the priority of this vs. other projects in 2017. If you haven't already, please signal your interest below[1].

So far it is a prototype, although it is based on the already proven code used in Semaphor[2], our encrypted group chat and file sharing application, so it's "just" a bunch of UI work now :-)

[1] https://spideroak.com/about/noteapp-signup [2] https://spideroak.com/solutions/semaphor/business/tour

rarrrrrr··on SpiderOakONE – Zero Knowledge Cloud Storage
Thanks for your feedback.

Just as a data point for comparison, Dropbox charges $100/year for 1000 GB, but they don't do meaningful encryption, and therefore can de-duplicate your files vs. the files of all their other customers, which significantly reduces their storage costs (and allows for some entertaining information leakages!)

SpiderOak charges $120/year for 1000 GB.

Edit to add: SpiderOak deduplicates files within a single user's account (i.e. copies are free, and if you add another layer to a photoshop file and re-save, it won't take up the full space to archive both versions) but it is not possible [1] for us to deduplicate data across multiple users.

[1] https://spideroak.com/articles/why-spideroak-doesnt-deduplic...

rarrrrrr··on SpiderOakONE – Zero Knowledge Cloud Storage
Thanks for jumping in with suggestions. It's actually a harder problem than it seems! I have a feeling "provider-obscured" and "homomorphic" (while accurate!) are significantly less accessible to end users. I'll try to break it down:

Do end users talk about the services they purchase using the word "provider"? Is for example, Facebook or Twitter commonly referred to as a social media "provider?" The most common example I can think of is ISP, but I rarely hear non technical people say "ISP". They say something like "I get Internet from Time Warner" instead.

Is "obscured" a commonly used, highly accessible word? Can you think of a few popular movies or books with that word in the title? Is it commonly used in news headlines?

So the proposal is a hyphenated phrase of these two uncommon words. I think it's likely "Zero Knowledge" would crush "Provider-Obscured" in an A/B test. Ditto for "Homomorphic."

Seeing highly technical terms in headings makes non technical people believe that the software is complex and hard to use, and is therefore not for them. IMO, this is one of the classic failings of security products in general. It needs more study.

rarrrrrr··on SpiderOakONE – Zero Knowledge Cloud Storage
Thank you. I'm all for switching if we can find a phrase that's accessible to non technical people.

Ideally it would be a phrase that's adopted by many sites, the press, etc. (as Zero Knowledge has been, for better or worse.) It should accurately convey the situation that 1) the data is meaningfully encrypted 2) the meta data is meaningfully encrypted and 3) only the customer has access to the encryption keys.

rarrrrrr··on SpiderOakONE – Zero Knowledge Cloud Storage
Thanks for the feedback. Sorry it didn't work out for you.

FYI, the SpiderOakONE app and the backend storage service received a refresh in 2016, and another one is underway right now (now all needed libraries are Python3 compatible!)

The existing UI is oriented toward power users, and is a bit complex for most people. The upcoming refresh simplifies many things while retaining the flexibility under "advanced" settings.

rarrrrrr··on SpiderOakONE – Zero Knowledge Cloud Storage
Thanks for the feedback. For what it's worth, we did try a bunch of alternative wordings, and Zero Knowledge was the phrase that non technologists found most accessible.

We prioritized making the explanation clear to non-experts vs. to the community of cryptographers.

rarrrrrr··on SpiderOakONE – Zero Knowledge Cloud Storage
It's mostly that the desktop app is Python and C, and there wasn't a clear path to make that same code base run on mobile, so the mobile app is just a reader.

However for Semaphor, our encrypted group chat and file sharing tool (akin to IRC, to Slack or HipChat) the internals are written in Go and it's the same code base on all platforms, including mobile. That source code is also published for security review. We plan to migrate SpiderOakONE to use that same stack so the mobile experience is the same as desktop.

rarrrrrr··on SpiderOakONE – Zero Knowledge Cloud Storage
SpiderOak founder here...

A few cryptographers have noticed SpiderOak's marketing term Zero Knowledge is inconsistent with the academic definition. Maybe it doesn't mean what we think it means[1]? SpiderOak was one of the first companies to use this phrase commercially and the need has only grown stronger.

At the heart of the issue is the difficulty for end users to decipher the terms cloud vendors use to describe their security. Doing so would require discrimination between transport encryption, data encryption, meta data encryption, encryption at rest vs. in motion, and then most importantly evaluate key management and access. This vocabulary is foreign to most folks. Vendors often exploit the inaccessibility of these topics to make a series of statements that, while often factually correct individually, together create a false sense of privacy.

SpiderOak launched a online backup product for Linux, Mac, and Windows in 2007. The competitors were companies like Xdrive, Mozy, Carbonite and SugarSync. Each claimed that customer data was fully encrypted. Even the most credible journalists writing for well funded publications with fact checking budgets were fooled and repeated these misleading claims to end users. [2]

In 2009 when Dropbox launched, they made misleading claims about the encryption of customer files and their internal ability to access customer's data or provide that data to 3rd parties, leading to a well publicized FTC deceptive trade practices complaint. [3] The deception had been so effective that leading software engineers were shocked to discover Dropbox had full access to the data they had stored online. [4]

In response to customer requests on one of their forums, Mozy explained why it would be "impossible" for a storage service to protect users' privacy by encrypting the file and folder names customers store in a way Mozy could not read. SpiderOak customers had benefited from the impossible for years.

Recently Slack made the unbelievable claim on Twitter that their service includes end to end encryption (it doesn't.) Perhaps they mean from your end to their end?

Lately there's a new phrase "customer managed keys" used by cloud providers, which sounds really great, but is typically just elaborate hand waving that ultimately allows the vendor and their staff the same level of data access as if it were not encrypted.

In 2007 we found ourselves frequently explaining "we don't know the names of your files, the names of your folders, the date they were created or last modified or accessed, their size, their checksums or hashes... in short we know nothing about your data except how much you store." We started using the phrase Zero Knowledge as a headline to this long explanation.

It's important to recognize that cryptographers already understand encryption and the terminology is intended for everyday folks. When I'm speaking with a technologist about how SpiderOak products work, I would typically use the phrase end to end encryption.

If we want to end mass surveillance, the only way this can happen is through viral adoption of end to end encrypted products and services. Great UX, education, and terminology are powerful tools, and unlike phrases involving the word "encryption", to my knowledge no company has yet been shameless enough to deceptively use the term Zero Knowledge.

[1] https://www.youtube.com/watch?v=G2y8Sx4B2Sk

[2] http://allthingsd.com/20080403/sugarsync-offers-the-best-met...

[3] https://www.wired.com/2011/05/dropbox-ftc/

[4] http://tirania.org/blog/archive/2011/Apr-19.html

rarrrrrr··on AdultFriendFinder was hacked
If you're being proactive about it, one approach is to create "canary" accounts: single purpose email addresses that signup for your service and nothing else. When those email addresses start getting spam, it's a strong indicator your database has been accessed.

Many users signup for each online service with a single-purpose email address. e.g. <servicename>@uniquedomain.com, so many customers will often know of a leak as soon as the service provider does.

rarrrrrr··on Ask HN: What good open source projects written in React that I can learn from?
Not sure just what you're looking for, but SpiderOak's Semaphor is a desktop/mobile end-to-end-encrypted Slack alternative where the presentation layer is React, and the client side app backend (networking, crypto, database) is Go. That keeps the React code focused and easy to follow.

Source is here: https://spideroak.com/solutions/semaphor/source

rarrrrrr··on Cryptpad: Zero Knowledge, Collaborative Real Time Editing
This is a fair question. I'm somewhat to blame for contributing to it over the last 10 years via SpiderOak. There are very good reasons though, and it's probably time I made a post about it.
rarrrrrr··on Roughtime: a protocol for secure, auditable time synchronisation
SpiderOak might be interested in running a Roughtime service / participating in a Roughtime community to support Semaphor.

As it is, Semaphor clients include a local timestamp among the signed content of most actions, and the server rejects actions that aren't within some tolerance (strict ordering however is accomplished via hash chain.) Roughtime would allow improving this situation from several angles.

One of the logistical challenges is client network traffic footprint. Enterprises that deploy a collaboration solution often want to have a strict definition of which upstream servers it can be expected to talk to. Would it be possible for a single Roughtime service to incorporate verifiable information from a larger Roughtime community, such that end user clients don't have to communicate with additional addresses?

rarrrrrr··on Ryver: Why we run negative ads against Slack
> "we encrypt all of your chats so even we cannot tell what you're talking about."

FWIW, the bit about end to end encryption (including channel names, attachment meta data, etc.) and being created by an established company with other profitable products describes SpiderOak's Semaphor pretty well.

rarrrrrr··on Snowden’s Favorite Cloud Service Now Has a Group Chat App
Your "temporary" criteria is not yet available in the 1.0.x version of Semaphor, but the very near term roadmap includes retention policy per channel/conversation, with settings like "N days" and/or "N messages". Then Semaphor uses ephemeral key rotation to match the retention policy (i.e. both the messages and ephemeral keys are destroyed as the retention expires.)
rarrrrrr··on Snowden’s Favorite Cloud Service Now Has a Group Chat App
Sorry! Ironically (since we're using Google's Golang) Android has been the hardest platform for us to finish. We've got Mac, iOS, Linux, and Windows now, and are running Android internally but it's not release ready yet. Should have it within a few weeks. It is likely to require a newish Android version though. Thanks for taking a look!
rarrrrrr··on Snowden’s Favorite Cloud Service Now Has a Group Chat App
Thanks for taking a look and for your feedback! Do you have any recommendations for us for alternative pricing?

One of the things we tried to accommodate is that teams can be paid for by the individual members instead of one entity having to foot the whole bill. This was one of the common complaints we saw about Slack, where large communities enjoy using it but had no way to pay for better service.

You can use Semaphor for free just like Slack, with limited historical content retention.

Also, for what it's worth, I use Signal daily for personal messaging, and my own experience with it has been great. We think of Semaphor and the team/business context as as having pretty different requirements (and therefore somewhat different underlying crypto structures) than individual messaging. The biggest differences are about message retention and what happens when you want to invite a new member to an established conversation.

rarrrrrr··on Snowden’s Favorite Cloud Service Now Has a Group Chat App
Great question!

We really wanted to use the pure go implementation, but it doesn't cover as much functionality. Detached signatures for example.

rarrrrrr··on SpiderOak Semaphor [video]
Thanks for your interest in Semaphor! FYI, Today is an early access preview. iOS, Android, Linux, and Windows coming very soon; we built mobile first and are running all of the above internally. Cheers!
rarrrrrr··on SpiderOak Semaphor [video]
(I didn't submit this, but thanks to the OP! This is an early access preview... General availability is very soon)

10 years ago SpiderOak made a zero-knowledge cloud storage product which is now called SpiderOakONE and is comparable to Dropbox. Semaphor is a new app, analogous to Slack or HipChat, with end-to-end encryption, and team/enterprise focused.

It's written in Golang with the client side (local) presentation layer in React. Source and a white paper are published. Cheers!

rarrrrrr··on SpiderOak Semaphor [video]
... easter egg. I'm not _quite_ that fast. Dvorak keyboard FTW. :)
rarrrrrr··on SpiderOak Semaphor [video]
There's quite a bit more info here: https://spideroak.com/solutions/semaphor/tour
rarrrrrr··on SpiderOak Semaphor [video]
Good guess. We were thinking of these: https://en.wikipedia.org/wiki/Flag_semaphore

Semaphoric patterns are used in the application as a more visually appealing means of peer key verification, device provisioning, etc. than say, QR codes.

rarrrrrr··on SQLite schema boilerplate for user accounts, roles, logins and auth tokens
That was true for a long time, but newer sqlite can do table level locking when in shared cache mode. Section 2.2 here: https://www.sqlite.org/sharedcache.html
rarrrrrr··on SpiderOak Encryptr – Zero-Knowledge Password Syncing
Thank you! We'll take a look.

By the way: I recognized your nick from various repos you've authored/contributed to. Always really solid stuff!

rarrrrrr··on SpiderOak Encryptr – Zero-Knowledge Password Syncing
Thank you for your interest and efforts to contribute to the project.

I think there were some questions about your patch that you did not answer, and reviewers moved to other projects. Honestly we felt overall the patch was low quality. Certainly the serious error in the first version of the patch which dramatically added bios didn't help. In general we had already completed auditing the selection approach taken by the existing password generation code and did not want to consider a different approach for little benefit.

We should have given you better feedback. Sorry.

rarrrrrr··on Responsibly Bringing a new Cryptography Product to Market
Thanks for your feedback and your interest in Crypton!

First, for the record, from that Reddit AMA, Daniel isn't a SpiderOak founder and is no longer with the organization.

Next, we throughly agree of the necessity for open sourcing our desktop backup and sync product, and are working towards that. There are licensing issues that have to be worked out. We started SpiderOak in 2007. Everything new we've created since 2009 has been open source from the start. Our expectation is that the existing SpiderOak product will someday transition to using Crypton internally.

← PreviousPage 2 of 11Next →