HNHacker News
TopNewBestAskShowJobs

douglasfshearer

728 karma · joined January 13, 2011

Software engineer. CTO at Distrify Media. Co-host of Pincount Podcast.

github.com/dougal @douglasfshearer

submissionscomments
douglasfshearer··on Cloud TPUs in Beta
P3.16x benchmark is ResNet-152, TPU cost of $200 was for ResNet-50.

Tensorflow benchmarks show ResNet-152 resulting in 2.4x lower throughput than ResNet-50. [0]

[0] https://www.tensorflow.org/performance/benchmarks

douglasfshearer··on Firmware Updates and Initial Performance Data for Data Center Systems
100% of the original power usage. Not a 100% increase in power usage, that wouldn't be thermally possible in cases of high CPU load.
douglasfshearer··on How to store 50k mails in 10M to fight Spammers
Spam receiving services seem to provide fertile ground for heavy optimisation of storage.

See also Mailinator. [0]

[0] http://mailinator.blogspot.ae/2007/01/architecture-of-mailin...

douglasfshearer··on Intel Confronts Potential ‘PR Nightmare’ With Reported Chip Flaw
SEC rules also cover cancellation of orders.

https://en.wikipedia.org/wiki/SEC_Rule_10b5-1#A_possible_loo...

douglasfshearer··on Of SVG, Minification and Gzip
To save others time, the output of GZThermal is a PNG image called gzthermal-output.png.
douglasfshearer··on Building a fast, secured and free static site in less than three hours
Neocities [0] does all of this!

- It's free (though you can become a supporter and get some extra benefits) [1]

- It's fast, since it uses it's own CDN. [2]

- It's secure, all pages support SSL, even with custom domains. [3]

- It has a command line tool [4] that can be wrapped to automate upload of pages, or used in a Git hook.

- It has a plethora of learning resources [5].

[0] https://neocities.org

[1] https://neocities.org/supporter

[2] https://www.youtube.com/watch?v=-i6wvix6buI

[3] https://blog.neocities.org/default-ssl.html

[4] https://neocities.org/cli

[5] https://neocities.org/tutorials

douglasfshearer··on The Huge Premium Intel Is Charging for Skylake Xeons
> Nobody ever got fired for buying IBM.

Replace IBM with Intel for the 2010s version.

douglasfshearer··on The AWS Spend of Our SaaS Side-Business
Great post. It's good to see an enterprise smaller than Segment [0] talk about how complex AWS pricing is.

You mention you use SQS to queue incoming metrics. What server/framework/language are you using to do this? IME using SQS requires tools with good parallelism to deal with it's high-latency/high-throughput performance characteristics.

[0] https://segment.com/blog/spotting-a-million-dollars-in-your-...

douglasfshearer··on HEIF – High Efficiency Image File Format
Apple just announced support at WWDC.
douglasfshearer··on Pinboard Acquires Delicious
Maciej publishes a yearly progress statement [0] with revenues and costs included.

[0]https://blog.pinboard.in/2016/07/pinboard_turns_seven/

douglasfshearer··on AMD 16-Core ThreadRipper Enthusiast CPUs to Reportedly Utilize 4094 Pin Socket
Intel are moving to a similarly big socket for next-gen Xeons, LGA-3647 [0]. It's already in use for socketed Phi processors.

[0] https://en.wikipedia.org/wiki/LGA_3647

douglasfshearer··on A Trillion Edge Graph on a Single Commodity Node
The Larrabee project, and all the things it spawned [1], is fascinating.

[1] http://tomforsyth1000.github.io/blog.wiki.html#%5B%5BWhy%20d...

douglasfshearer··on A Trillion Edge Graph on a Single Commodity Node
The paper doesn't mention "commodity", and I'm not sure that one to four Xeon Phi can be described as commodity.

Can the title be edited?

douglasfshearer··on New Bridges Rise in New York
In the case of the Queensferry Crossing I wonder if ease of cable replacement is one of the reasons behind the design choice. The Forth Road Bridge [0], a suspension bridge over the Forth to the East of the Queensferry crossing, has suffered from cable corrosion [1]. There is no easy way to replace the main cables in a suspension bridge without first removing the deck it suspends, causing years of service interruption. In a cable-stayed bridge it seems you could perhaps replace one cable at a time while the surrounding cables take the load.

I live with a view of the bridges, it has been fascinating watching them construct the new bridge.

[0] https://en.wikipedia.org/wiki/Forth_Road_Bridge

[1] http://www.bbc.co.uk/news/uk-scotland-edinburgh-east-fife-32...

douglasfshearer··on More Extreme in Every Way: The New Titan Is Here – Nvidia TITAN Xp
Someone updated the 10-series Wikipedia page [1] making comparison to the previous card easier.

Compared to the Titan X Pascal it has more cores, a higher clock, and more memory bandwidth.

[1] - https://en.wikipedia.org/wiki/GeForce_10_series#GeForce_10_....

douglasfshearer··on Ask HN: Is S3 down?
It seems status pages should be on entirely independent infrastructure, give the criticality of the information they provide. Perhaps even a separate domain.
douglasfshearer··on Evernote’s transition to Google Cloud Platform
The Evernote engineering team posted a five part blog post [1] that goes deep on the detail of the migration and work to maintain consistency.

TLDR: Shard at a time was replicated over the network, then live traffic was cut over to the Google Cloud replica.

[1] https://blog.evernote.com/tech/2017/02/08/part-1-evernote-se...

douglasfshearer··on Liberouter Combo Cards – FPGA boards focused on network data processing
Amazon announced they were doing network processing in hardware at Re:work last week [1].

Custom silicon, rather than the FPGA or ASICS they were using when they started the project in 2012.

They tout not only the freed CPU resources, but lower latencies and increased security of isolating the networking from the CPUs running hosted VMs.

https://youtu.be/AyOAjFNPAbA?t=1822

douglasfshearer··on Flv.js – An HTML5 Flash Video Player
A similar idea, HLS.js [0], allows playback of HLS on platforms that do not support it natively. Open-sourced by Dailymotion, it is used by The NYTime [1] amongst others to reduce the number of video renditions they have to produce for each video.

[0] https://github.com/dailymotion/hls.js

[1] http://open.blogs.nytimes.com/2016/02/08/flash-free-video-in...

douglasfshearer··on Timing the time it takes to parse time
Simple optimisations like this shave minutes off the runtime of log parsing and data import jobs I run.

I do lots of this in Ruby [0], and often write a custom parser when I know that dates or times will be of regular form. As a bonus I get to golf different methods of doing the parsing against each other, using microbenchmarks.

[0] https://gist.github.com/dougal/e972b26cd0293f99b41896e7d89c0...

douglasfshearer··on Building fast.com
YouTube also put the byte range in the URL rather than using a range request header.

Perhaps it mitigates against proxies stripping the headers, or it simplifies caching.

douglasfshearer··on How We Replaced React with Phoenix
Their pain point was having multiple frameworks which a contributor would have to be familiar with to make changes to the application. Moving from two frameworks, to a single framework, increased the number of contributions to the application.

They traded outright frontend performance, so as to increase the iterations on what is an internal tool, and thus make it more useful to the company.

douglasfshearer··on BackBlaze B2 out of beta
You give a figure for object durability of 99.999999%. Is this in a single datacenter only?

If so, is there a timeframe for multi-DC redundancy?

This is the only thing stopping me from moving large amounts of data into B2 right now.

douglasfshearer··on Custom Processor Speeds Up Robot Motion Planning
You can do both CPU and GPU, but time and power consumption are both order-of-magnitude worse than using dedicated hardware. The robotic arms are also used untethered in factories, where having a computer near them is inconvenient.

The article describes results for using a Xeon CPU. The linked paper cites other papers where a GPU was used.

douglasfshearer··on GE's Walking Truck (1969) [video]
The walking tree harvester, called PlusJack, was a development project by Timberjack (now part of John Deere) revealed in 1999.

The machine never entered production due to high manufacturing and maintenance costs, as well as the speed at which it could cover ground.

The prototype is now housed in The Museum of Lusto [1] in Finland (near bottom of page for pictures).

[1] http://www.unusuallocomotion.com/pages/museums/museum-of-lus...

douglasfshearer··on Introducing DGit
Github's dgit is an internal infrastructure tool, it doesn't appear to have been open sourced.
douglasfshearer··on TechEmpower Framework Benchmarks Round 12 – Race Against the Thermite
Sadly this round of tests was rather rushed due to the imminent decommissioning of the donated hardware used to run these benchmarks [1].

There was no pre-release of the results to contributors, meaning that frameworks with unusually high error rates were not investigated. I am thinking particularly of Phoenix [2], as this is the first round in which it was included.

Hopefully for round 13 they will have better availability of hardware, and be able to follow to the release process they have previously used.

For anyone able to help, they are looking for a donor for test machines [3].

[1] https://groups.google.com/d/msg/framework-benchmarks/Hq4qxj0...

[2] https://groups.google.com/d/msg/phoenix-talk/6cjJx61FPBg/LGs...

[3] https://groups.google.com/d/msg/framework-benchmarks/IiDBC6l...

douglasfshearer··on FFmpeg 3.0 released
How did the costs compare with this setup?

I work on a project where ET isn't flexible enough (MPEG-DASH), and wondered whether Lambda would make for a good alternative to EC2 + SQS + Scaling Groups.

douglasfshearer··on A Complete Guide to Rails Caching
Fantastic resource.

No mention of HTTP caching though, which for a whole class of applications is a great way to minimise rendering time.

Rails has great support[1] for etag based content expiry.

[1] http://api.rubyonrails.org/classes/ActionController/Conditio...

douglasfshearer··on Learning Curves for Different Programming Languages
The author is using the Matplotlib Python library. [1]

Similar style charts to that used by Randall Munroe in XKCD.

See also this D3 style for producing similar charts by Dan Foreman-Mackey. [2]

[1] http://matplotlib.org/xkcd/examples/showcase/xkcd.html

[2] http://dan.iel.fm/xkcd/

← PreviousPage 2 of 3Next →