HNHacker News
TopNewBestAskShowJobs

mileswu

366 karma · joined March 14, 2012

submissionscomments
mileswu··on DMARC Secured Email Identities but Broke Mailing Lists
Forwarding email with outlook.com/Office365/Microsoft Exchange also breaks DMARC. Exchange Server sometimes modifies the headers of emails when forwarding them, invalidating the DKIM signature, so then a DMARC policy rejects the forwarded email. Apparently Microsoft have a fix in the pipeline for this, but it's been taking ages.

More info at: https://blogs.msdn.microsoft.com/tzink/2016/05/19/why-does-m...

mileswu··on Neocities is implementing IPFS – distributed, permanent web
CERN still uses AFS extensively for all users' files. I believe they use a forked version of OpenAFS. My experience with it at CERN has been okay. It's been fine to use locally, but transatlantic over the Internet can be very slow (it does work eventually though).

I'm not sure if there are any alternatives that work any better over long distance. I suppose CERN also has CVMFS [1], which is a read-only caching filesystem that retrieves the files from upstream via HTTP. This works much better, but it is read-only so only satisfies certain use cases.

[1] http://cernvm.cern.ch/portal/filesystem

mileswu··on BB84 – A quantum key distribution scheme
Quantum Key distribution is different from classical ones in that it allows Alice and Bob to detect Eve. This is because a measurement in Quantum mechanics disturbs the state. In particular for BB84, a measurement by Eve in the wrong basis destroys the correlation of Alice and Bob in the correct basis.

Unlike classical key distribution, these guarantees derive from fundamental physics laws as opposed to, say, RSA that can be broken given enough computing power/time, and so are unbreakable.

Unfortunately there can be flaws in actual implementations of the BB84 scheme, such as side-channel attacks. E91 [1] (a newer scheme) addresses these flaws and prevents these attacks.

[1] http://journals.aps.org/prl/abstract/10.1103/PhysRevLett.67....

mileswu··on Show HN: dokibox – an open source music player for OS X
Author here. Been working on this on and off for about 3 years now as a side project and it's my first 'large-ish' OSX app. Would love comments or suggestions! Thanks.
mileswu··on The Worst Amazon Horror Story I Have Ever Heard
Previous HN discussion (~10 months ago): https://news.ycombinator.com/item?id=6751710
mileswu··on Show HN: Get a list of your Amazon purchases and see what you can sell them for
Just an off-the-top-of-my-head idea: Could you give people a bookmarklet or an extension that they can run when they are on their order history page that exports all the Amazon product IDs?
mileswu··on Packed Pixels – An extra monitor for your laptop
This is very similar to another product that you can buy today https://www.adafruit.com/products/1652. It's basically an iPad 3/4 retina display that connects via DisplayPort. The main differences seem to be that the Kickstarter one will run off USB power (instead of 9V) and attaches to your laptop screen.

I've been tempted to try it, but can't really think why I'd need it.

mileswu··on Introducing a simpler, faster GitHub for Mac
I used to use it just for the ability to individually stage chunks/lines, because I find "git add -p" incredibly hard to use. Now I tend to use GitX-dev for OSX [1] to do that instead, because I find it more powerful than Github for Mac. There's also a ncurses-based interface for git called tig [2] which can also do the chunk staging, but I only use it when I don't have a GUI.

[1] http://rowanj.github.io/gitx/ [2] http://jonas.nitro.dk/tig/

mileswu··on The homogenization of scientific computing (2013)
For high-energy experimental physics (HEP or particle physics), most tend to use a CERN developed C++ framework called ROOT[1]. It's not overly pleasant, but it gets the job done.

There are Python bindings to ROOT (pyROOT) but I've found Python in my experience to be a bit too slow when handling the large (10TB+) datasets.

As an aside, it's interesting how ROOT attempts to provide C++ with some basic reflection[2] and saving of C++ objects to dis. Unfortunately it doesn't necessarily do a very good job of it, but perhaps things will change with ROOT6 as it transitions to being based on clang, as opposed to in-house C interpreter.

[1] http://root.cern.ch/ [2] http://root.cern.ch/drupal/content/reflex

mileswu··on We scraped the World Bank's website
An interesting and somewhat related (but only tangentially) article I read a couple of days ago found that nearly 1/3rd of World Bank reports are never read, not even by a single person: http://www.washingtonpost.com/blogs/wonkblog/wp/2014/05/08/t...

It was submitted to HN (https://news.ycombinator.com/item?id=7715881) by another user, but probably never got traction because the title of the article is very vague.

mileswu··on Git add -p
There's also a ncurses-based interface for git called tig[1]. I find it a bit easier to stage chunks/lines than git add -p as it's interactive. When I'm not on a command line, gitx-dev for OSX [2] also makes it very easy too.

[1] http://jonas.nitro.dk/tig/ [2] http://rowanj.github.io/gitx/

mileswu··on Ask HN: To everybody who uses MapReduce: what problems do you solve?
At least on the experimental LHC side, we process/analyse each event independently from every other event, so it's an embarrassingly parallel workload. All we do is split our input dataset up into N files, run N jobs, combine the N outputs.

Because we have so much data (of the order of 25+ PB of raw data per year; it actually balloons to much more than this due to copies in many slightly different formats) and so many users (several thousand physicists on LHC experiments) that's why we have hundreds of GRID sites across the world. The scheduler sends your jobs to sites where the data is located. The output can then be transferred back via various academic/research internet networks.

HEP also tends to invent many of its own 'large-scale computing' solutions. For example most sites tend to use Condor[1] as the batch system, dcache[2] as the distributed storage system, XRootD[3] as the file access protocol, GridFTP[4] as the file transfer protocol. I know there are some sites that use Lustre but it's pretty uncommon.

[1] http://research.cs.wisc.edu/htcondor/ [2] http://www.dcache.org/ [3] http://xrootd.slac.stanford.edu/ [4] http://www.globus.org/toolkit/docs/latest-stable/gridftp/

mileswu··on Panasonic Toughbook Tablet
If they can make a 20" 4K display and put it in a tablet, then why can't they just mount it in a desktop display and I'd be interested in buying it (though whether I have the money is a completely different question). I'm sure it would be easier to manufacture if they didn't care about weight/power consumption and there might be a bigger market.
mileswu··on Generating a private key I can trust
> First of all I do not trust any hardware. It’s impossible to verify that the hardware doesn’t have a backdoor and randomness looks random even if tampered with.

Well if you can't trust any hardware, how can the author trust any off-the-shelf computer and CPU to generate the private key even if he is using Linux+GPG? For all he could know the CPU could contain a backdoor that performs the necessary arithmetic and operations incorrectly (in the process making the key weaker).

He is also trusting his CPU to do the session encryption correctly (even with his external smartcard). Perhaps the CPU could leak information about the session key to another processes, allowing people to decrypt your communications?

Now I trust my CPU and hardware, especially because we have little alternatives. Perhaps it would be better to use an external smartcard to generate the private key too, because the physical hardware is orders of magnitude less complicated than a CPU/computer, so you could verify the hardware contains no backdoors by examining the physical circuits using a microscope (I presume this would still be very hard to do but millions of times simpler than that for a modern CPU).

mileswu··on EFF's HTTPS Everywhere removed from Chrome app store
It was asking me which SSL client cert I wanted to present to identify to beta.bbc.co.uk. In my case I have my StartCom one and a OSG science one.
mileswu··on VLC for iOS returns on July 19, rewritten and fully open-sourced
There are many rendering filters and pipelines available for DirectShow (and therefore MPC-HC) that VLC does not have. For example MadVR[1] improves upscaling and display rendering quality dramatically and xy-VSFilter can render subtitles many times faster than libass which is used in VLC.

These are just two examples that I came up with off the top of my head, but there are countless more. The advantage of VLC is that it's simple and just works out of the box for 95% of stuff, but MPC/Directshow gives you far more flexibility as you can construct a very custom filter chain (eg. using different decoders and renderers).

[1] http://forum.doom9.org/showthread.php?t=146228 [2] https://code.google.com/p/xy-vsfilter/

mileswu··on Desert Bus: The Worst Video Game
How about Big Rigs: Over the Road Racing?

- Description talks about outrunning cops to deliver illegal goods, but there are no cops in the game

- AI opponents never move

- No collision detection

- Infinite speed in reverse gear

- Sometimes says you've won before you even left the start line

- The fifth (out of 5) map doesn't load and crashes the game

- A patch to fix the fifth map just turns it into the first map but mirrored (so I guess they couldn't work out how to fix it)

Weirdly somehow I think tens of thousands of copies of this were sold. I pity the people who wasted money on this.

mileswu··on Show HN: My side project that grew - cheap SSL certificates
I get my SSL certificates from Namecheap[1]. Here the cheapest ones are $9/yr (they are the same certificates as the OP's cheapest ones) and they're I suppose a well-known domain registrar.

[1] https://www.namecheap.com/ssl-certificates/comodo.aspx

mileswu··on How To Split A Pizza
There is also the Pizza Theorem[1] which says that even if you don't cut the pizza through the middle but so long as the slices are of equal angles, you can divide it equally by area by choosing alternating slices.

[1] https://en.wikipedia.org/wiki/Pizza_theorem

mileswu··on How easy it is to Socially Engineer Microsoft Skype Support
> In my case the hacker asked to all my contacts with an automatic message for some Liberty Reserve money. Most of them trust me and my account, so they were inclined to accept.

I'm not sure why anyone would give money to a friend via Liberty Reserve, just because a friend requests some via an instant message. The average person has probably never heard of Liberty Reserve either. Before sending any money of any kind, wouldn't one ask the friend what's wrong whereupon it would become obvious it's not them?

Maybe I'm just deeply skeptical and distrusting and the rest of the world is more optimistic.

mileswu··on University of Reddit
Have you obtained a license to use the reddit name/brand along with the mascot/logo?

"For all of the above reasons, we require a license if you want to use the reddit brand in anything you do, both for free and for profit."[1]

[1] http://www.reddit.com/wiki/licensing

mileswu··on Have Scientists Found Two Different Higgs Bosons?
This is how I lean too. A few percent in a mass measurement is a pretty small systematic error and could easily come from something that has been overlooked or miscalibrated. There are a tens and hundreds of calibration and corrections that go into these detectors and analyses and it's all too easy to miss something.

What really makes me convinced it is an experimental error is that CMS does not see the same mass discrepancy. If both independent experiments saw the same discrepancy then this would truly be really interesting new physics.

Disclaimer: I am on ATLAS myself, though not associated with the Higgs groups. I can only comment on public results due to much information being confidential.

mileswu··on Why the Amazon App Store sucks and you should stick with Apple
He could always sell his software via his own store, as Kindles are not restricted to Amazon App Store sold software (which is one difference between the Kindle/Android ecosystem and an iOS one).
mileswu··on New 25 GPU Monster Devours Passwords In Seconds
It encrypts all your passwords using AES with a 128 bit key derived from your master password (PBKDF2) [1].

This is very different to what the article is talking about, since it encrypts your passwords, but the article talks about hashing which is one-way.

[1] http://help.agilebits.com/1Password3/agile_keychain_design.h...

mileswu··on New 25 GPU Monster Devours Passwords In Seconds
“I was extremely disappointed that setting up a clustered VMware instance wouldn’t allow me to create a VM that spanned all the hosts in the cluster. E.g. if i had five VMware ESX hosts with 8 processor cores, I wanted to be able to create a single vm with 40 cores and use all nodes in the cluster,” he wrote.

Not sure why he would have thought this would be possible. This would be an extremely hard problem given the latency involved between different nodes.

Then he came across VCL, or Virtual Open Cluster... “It did just what I wanted, not with an entire OS per se, but with an entire OpenCL application. and that’s good enough for me.”

A similar (but far older) system is MPI[1], which enables parallel computation across many compute nodes for your code by providing message passing. It's kind of a pain to use in my limited experience since you have to adapt your code (it seems like VCL is transparent for OpenCL programs), but it does work. No need for OpenCL, tho of course you could always use OpenCL + MPI. A common thing I see is MPI+OpenMP (for parallel cpu computation).

[1] https://en.wikipedia.org/wiki/Message_Passing_Interface

mileswu··on Cab Drivers, Uber, and the Costs of Racism
There's still racial inequality if you have to pay extra (to use Uber) to get a similar service that other races can get cheaper (normal cab).
mileswu··on $15 Dedicated servers from OVH
Although I've never tried them, there's http://www.server4you.com/root-server/ that is relatively good value for money, but still a little more expensive. I don't know how their support/reliability is.

I actually use OVH on some older Kimsufi plans. I'm kinda disappointed actually with these new plans as they got rid of the Core i5/i7 processors which were a bargain for the amount of CPU power you got for the money.

mileswu··on Google Fiber is live in Kansas City, real-world speeds at 700 Mbps
Universities and research institutes are also connected to private peering links such as ESNet[1] or Internet2[2]. This is actually a huge benefit because these links are typically uncongested and you can get much more reliable transmission on them (and hence consistent latency and faster transfer speeds). Other countries/continents also have their own private academic networks that peer with the US ones.

I think I read somewhere that they are upgrading the ESNet backbone to be 100Gbit/s and GEANT's[3] to be 1000 Gbit/s, so I wouldn't immediately write off University/academic networking as automatically inferior to Google's.

Honestly it's hard to tell without knowing any of the details of how much capacity Google is provisioning in Kansas City (and how much contention there is). How much backbone fiber is laid to KS/MO - it doesn't seem to be where existing big-scale connectivity is (unlike say, DC Metro area where a ton of datacenters are located or London/Paris/Amsterdam).

[1] http://www.es.net/ [2] http://www.internet2.edu/ [3] http://www.geant.net/pages/home.aspx

mileswu··on Introducing Wakari - Scientific Python in the cloud
> We absolutely intend to make it a powerful platform for computation on big datasets.

The datasets I run on tend to be several terabytes and all the clusters that I use utilize various distributed filesystems (eg. Lustre [1] or Dcache [2] or Xrootd [3]) to store these files across local storage on all the nodes of the cluster.

I think for big datasets some kind of support for these distributed filesystems will be necessary as most private (scientific) computing clusters use them. The complication is of course that to use these filesystems, one needs to build support for each access protocol into a python module (off the top of my head I'm not sure if they exist yet; perhaps they do). While most of these filesystems do offer standard posix 'mounting', this is usually not recommended for performance reasons.

Perhaps I'm outside of the intended use case anyway. To a certain extent this problem is solved for my field of research (of course nothing ever works all the time heh), as all LHC/OSG Computing Grid centers run the same Scientific Linux distribution with the theory being that any code that works on one should work on another.

But this sounds great for teaching classes and labs! I look forward to using it.

[1] http://wiki.lustre.org/index.php/Main_Page [2] http://www.dcache.org/ [3] http://xrootd.slac.stanford.edu/

mileswu··on Introducing Wakari - Scientific Python in the cloud
I can see this being useful for teaching environments, but I'm not so sure how useful this would be for actual scientific research.

Most universities tend to have their own computing cluster, which will make storing the (potentially large) datasets easier, and furthermore use of the CPU time is free!

Javascript ploting for the next set of graphs I need to produce for my research though is something I'm actually pondering about. It has the ability to be interactive which can be really helpful.

Page 1 of 2Next →