HNHacker News
TopNewBestAskShowJobs

smooc

183 karma · joined February 24, 2015

submissionscomments
smooc··on The factory that only builds white Toyota Land Cruisers
Correct. It's why landrover doesn't make its Defender available anymore. They can't fix the emissions to comply with modern regulations.

This was a reply to bombcar.

smooc··on The factory that only builds white Toyota Land Cruisers
Correct. It would just take a small nudge and the whole car would fall apart. Replacement parts are cheap though.
smooc··on The factory that only builds white Toyota Land Cruisers
I did the Amsterdam-Dakar banger challenge a few years ago. The story was that a Lada Niva has never made it to the finish line :-). Oh and Landrovers you could track by the oil they were leaking.
smooc··on What's SAP, and why's it worth $163B? (2020)
Did you know it has a Jupyter Notebook interface with python support?
smooc··on Got a rejection for mentioning Apple pre-release software, but I am not
Do we get to read the stories that end with a reasonable outcome? I highly doubt it.
smooc··on Got a rejection for mentioning Apple pre-release software, but I am not
What I find interesting is that we seem to perceive the App Store Review process as some kind of black and white thing, while it isn't. Like a pure function that only works with the input variables provided and no side effects. Guess what, there is an actual human on the other side that is reviewing your app (with support of automation tools obviously). That person will make mistakes, will bring his/her own opinion and might not be consistent and often won't be very elaborate. Kind of refreshing actually.

Interestingly, that's probably how most customers are handled by many of the submitted apps, if at all.

smooc··on Reversing hearing loss with regenerative therapy
O that's interesting. I was able to do the same (tv, refrigerator, etc). I also lived country side and I have hearing loss (35db) and tinnitus (sometimes? moderate?) in my left ear, but seemingly due to a virus infection.

I have never encountered someone else that was able to hear whether a tv was on or not. At what distance could you do that?

smooc··on Outlook just asked me if I want to upgrade to bigger ads
This is exactly what the Schrems I/II rulings encapsulated: the Privacy Shield agreement was ruled invalid as any guarantees made on the privacy of European Citizens data transferred to the US were deemed to be fake. This has put a lot of cloud migrations on hold particularly for companies that are dealing with sensitive data, like banks and health care, but also retailers.

So it is approached from the consuming end for better or worse.

smooc··on American spy hacked Booking.com, company stayed silent
The same goes for Banks, a.o. Dutch banks. They are a bit more picky though. Domestic and US is fine, Russian and Chinese is not.
smooc··on Ask HN: How did you get started in tech and/or Linux?
My mother was a teacher in computer science (called informatics here at the time). She brought the first computer into the house (8088) and even a "laptop" that was over 5 kilos (a sharp with lcd).

What got me into Linux was a little later in 1997. I was playing Quake and I found out that my ping times were 60ms lower over a modem 33k6 connection than with Windows. That got me sold. And I just had a knack for the command line.

During my student time I quickly found out that tech paid my bills a lot easier than working in a cafe. It didn't attract many girls though so I kind of tried to combine it ;-)

smooc··on Xrdp: An open source RDP server
We run over 500 concurrent desktops with Guacamole and XRDP in Kubernetes in non privileged conatiners. This allows us have a secure environment while still having it light weight and not having te resort to Citrix for example.

Anyone comparing VNC to RDP favorably is nuts. RDP is a much more optimized protocol for high latency, low bandwidth. Only Citrix compares favorably from user's point of view. Maybe NoMachine NX as well. Both i cannot get to work over https (nomachine) and kubernetes (citrix).

Not requiring a custom, vague client also helps.

XRDP uses a Xorg driver or is able to use a VNC backend. Even then its faster than VNC. It can use pam for authentication.

smooc··on Makani’s time as an “other bet” comes to an end
Interesting how people measure these endeavours always in the context of their perceived end goal. Remember "shoot for the moon and if you come half way you still got pretty far"? This is exactly that.

Learning what you can't do is as important as to know what you can do. I'm happy that Alphabet is doing these long term research projects and bets. >5 years I think, apart from government, only oil & gas companies project that long term, but they know much better what they will 'find'. What Alphabet does it moves the academic needle cause we learn so much on the way.

Maybe they can do better in publishing the results, cause that is an alternative to just shareholder value: society value.

smooc··on Cancer medicine generates enormous revenues but marginal benefits for patients?
Did you read the article? It states the drop in cancer mortality is largly due to the fall of smoking.

'A 2006 analysis concluded that “without reductions in smoking, there would have been virtually no reduction in overall cancer mortality in either men or women since the early 1990s.'

smooc··on Cancer medicine generates enormous revenues but marginal benefits for patients?
It is argued in the article that the survival rate didn't go up, but rather how it was measured: earlier detection means a longer period of survival since detection.

You argue that there was rapid progress in the last decade. The article agues the opposite (over decades even). It does this with citations and meta analysis where they find that much of the 'rapid progress' is not replicable. The article doesn't say that immunotherapy is not meaningful, but it does say it is over sold where there is hardly evidence of their benefit.

You also argue that the cost will come down, however there is no evidence for this. To the contrary even: according to the article it is going up significantly without any indication of improving.

Why do you state that the "bizarre claim" of not having improved treatment is "just wrong" without providing any supporting evidence for this?

smooc··on How to Manage Apache Airflow with Systemd on Debian or Ubuntu
Airflow maintainer here

Jupyter doesn't do scheduling and integrates pretty well with Airflow.

smooc··on How to Manage Apache Airflow with Systemd on Debian or Ubuntu
Airflow Maintainer here

Prefect was started by an Airflow maintainer and friend of mine who also contributed the dask executor to Airflow. Hi @Jeremiah!

smooc··on How to Manage Apache Airflow with Systemd on Debian or Ubuntu
Airflow maintainer here

If you have idempotent tasks, which is a best practice, it is possible to use Airflow in HA even in active/active. It might occasionally schedule a task twice, which should be caught but in any case mitigated by idempotency.

If you are looking for more Enterprise support you can reach out to Astronomer (disclaimer: I'm a advisor to them) or use a Google cloud hosted version (Cloud Composer). Both are great products.

smooc··on How to Manage Apache Airflow with Systemd on Debian or Ubuntu
Airflow Maintainer here: what you are describing is exactly what Airflow takes care of (or should).

I wonder what your issue is/was? Notebooks are supported by means of a Papermill operator (equivalent to how Netflix operationalizes notebooks) or PythonOperator/BashOperator which would just wrap around your notebook.

However to parralelize tasks Airflow needs to know a bit more hence you might have found it required to break up your notebook into individual tasks that combine into a DAG. Is that what you meant?

smooc··on Facial recognition: School ID checks lead to GDPR fine
No it doesn't. In no way an RFID token is equal to biometrical information. I can throw away the token, choose not to have it on me etc.

The dataset you are talking about is not just in/out but is a lot more comprehensive than that.

smooc··on King's College London breached GDPR sharing list of activist students with cops
The sharing might not be a direct violation, but profiling the students for this purpose most likely is. They probably didn't sign up with something that said "you are being profiled with the purpose to share this information with the Government if you meet some arbitrary archetype"
smooc··on IBM acquires Red Hat
So now everyone will be wearing blue pyjamas and talk about Watson while not delivering anything.

Seriously.

Can anyone explain why this would be good?

smooc··on Why Mastercard Doesn't Use OAuth 2.0
Any app that takes security seriously will need to take a layered approach. So while Oauth 2, which is just a framework contrary to oauth 1.0a, seems to outsource its integrity protection to TLS this isnt enough: others have already pointed out that many companies hijack TLS at their edge proxies. Banks do this bu requirement of the regulator.

So you would need additional defenses against tampering such as OpenID Connect. In the banking apps that I have been working with we implemented additional symmetric encryption on top of the protocol (yes obfuscating the keys) and all other kinds of small things.

I’m glad mastercard does not rely solely on TLS.

smooc··on Codec2: A Whole Podcast on a Floppy Disk
Ikzmjzn nsh
smooc··on GDPR for lazy people: Block all European users with Cloudflare Workers
I don’t see a lot of comments looking at the practical side of things. I am implementing GDPR and here are some suggestions:

1. Collect only what is necessary for providing your service 2. Make clear what you store and for what reason 3. Ask consent and give the opportunity to retract this consent as easily

Deletion:

1. PII means information that makes a person identifiable. This is the type of information that you need to remove 2. So if you are storing PII information for the use of profiling you will need to disconnect the profile from the PII information. E.g. you could use user table where you would overwrite the PII information with generic information. You can still use the now stale profile withou PII information (for example in statistics, aggregations etc), but you cannot tie it to a single person anymore. Ie. You should not be able to reconnect the person to profile you have stored. 3. As technical possibilities evolve you need to improve the disconnection over time.

There are legitimate business reasons to store some PII information. E.g. for security reasons, other laws etc. So IP addresses don’t need to be deleted from your web logs, but if not given consent you cannot use them for ads, sell them etc.

The required clarity that GDPR will bring to your data is actually going to benefit you. Your data scientists will love it, because the tooling that helps with Gdpr also helps with discoverability, data quality etc.

Enjoy GdPR, there is a lot of business opportunity in it.

smooc··on Dropbox saved almost $75M over two years by moving out of AWS
Hiring manager here.

While your reasons are valid you are missing an important one:

Resource scarcity: the engineers that I need allocate to infrastructure I rather have working on user facing features and improvements. Talent is scarce, being able to out source infrastructure frees up valuable engineering time.

This is one of the main reasons, for example, that Spotify (I’m not working for them) is moving to google cloud.

smooc··on Kubeflow – Machine Learning Toolkit for Kubernetes
This looks pretty cool. Is it dependent on Google’s kubernetes or can it be run on Openshift or DC/OS as well?
smooc··on Airflow and the Future of Data Engineering: A Q&A
Airflow uses Celery to horizontally scale its execution. The Airflow scheduler takes care of what tasks to run in what order, but also what to do when they fail, need to retry, don't need to run at all, backfill the past etc.

Spark for Airflow is just one of the engines where a transformation of data can happen.

smooc··on Airflow and the Future of Data Engineering: A Q&A
Starting from 1.8 you will be able to trigger dags through a rest API, that is fully supported.

Shaping DAGs dynamically poses a challenge to the scheduler on how to 'predict' what tasks need to run in the future. The scheduler needs to evaluate which tasks will need to run, without actually executing these tasks themselves. For Airflow in its current state that is a chicken and egg problem.

For the future, I can think of allowing dynamic dags being described through the Rest API, but that is definitely further out and has not really popped up yet on the horizon.

smooc··on Airflow and the Future of Data Engineering: A Q&A
Here is, a slightly outdated, article that compares several ETL workflow tools http://bytepawn.com/luigi-airflow-pinball.html . Why we choose Airflow was because of the following reasons:

* Scheduler that knows how to handle retries, skipped tasks, failing tasks

* Great UI

* Horizontal scaleable

* Great community

* Extensible; we could make it work in an enterprise context (kerberos, ldap etc)

* No XML

* Testable and debug-able workflows

smooc··on Airflow and the Future of Data Engineering: A Q&A
As far as we know Airflow is used in one of the teams (I think it maybe advertising). It does not mean the whole company has switched to Airflow, but some team decided it fitted their job better.
← PreviousPage 2 of 3Next →