temuze

Honest question: when dealing with time-series data, do you actually need every data point? Is that level of granularity really necessary?

IMO, it makes way more sense to decide the aggregations you want ahead of time (e.g. "SELECT customer, sum(value) FROM purchases GROUP BY customer"). That way, you deal with substantially less data and everything becomes a whole lot simpler.

Congrats!

Also, how's stride.io doing?

Not a bad exit for a company that raised a Series... H?

You all do great work! Love the NYPL :)

Any updates on full, scale-out clustering?

And are there any plans on supporting columnar storage, for very wide tables?

Seatgeek is moving into the primary market and they're crushing it. Hope they drive TM out of business.

I think there's three big reasons.

Reason #1: Apple has 243.7B in cash right now. That'll already push them to nearly Samsung's valuation.

Reason #2: Samsung's business is more vulnerable. Most of their profits came from the chips division:

https://money.cnn.com/2017/07/27/technology/samsung-profit-a...

Samsung sells components to many companies, including Apple. In fact, Samsung makes more money from iPhone than they do from the Galaxy S8:

https://www.theverge.com/circuitbreaker/2017/10/2/16404430/s...

As an OEM, Samsung has a much more vulnerable moat. What happens when Apple starts to make those components on their own? They already started doing it with processors. What about memory? They buy a ton of memory from Samsung.

Reason #3: reality distortion field :)

Great post!

> To keep the ‘small working set’ even smaller, we cycle these JobDBs roughly every 30 minutes. The manager cycles JobDBs when their target of filled percentage data is about to exceed available RAM.

I'm confused - why does JobDB's memory trickle up over time? Isn't it a database? Are you using MySQL's memory storage engine or something?

I don't know much about Erlang - wouldn't it be able to interface with HTTP in the same way?

NYC should stop building subways with tunnel boring. Instead, tear up the street, build the darn thing and then rebuild the street over it. This method is called cut and cover and it's what many countries do because it's substantially cheaper and faster:

https://ny.curbed.com/2017/9/19/16335068/nyc-subway-mta-stat...

Imagine if the 2nd ave line was done this way - sure you'd get a lot of pissed Upper East Siders, but their property value is going to skyrocket from the project anyway. As far as I'm concerned, they could deal with a year of inconvenience instead of getting it built over decades for magnitudes of money more.

Of course, the City Council would never agree to this plan. It's easier for them not to disturb anyone if they want to be re-elected...

> We’re creating a new programming language, tightly integrated with an editor, compiler and PaaS, to allow engineers to build distributed applications using high-level primitives.

Not sure if this is ambitious enough. Maybe you should make a database, too :)

But seriously, you'd have to convince me of a lot of things before I consider using a service like this, much less basing a business off of it:

1) The bar for your language is going to be high. Not only does it need to be appreciably better than everything out there, it needs to compensate for a lack of community / libraries.

2) You'll need to show me that your language is production ready. For most languages, it takes years to build up that level of confidence.

3) Holy vendor lock-in, Batman! What happens if you go out of business? You mean you're trying to lock me into an ecosystem that you haven't even built yet?

4) If that's not all, a new editor as well? Editors are substantially harder than most programmers think they are. It's hard to make them fast, harder to make them intuitive and there are tons of companies who focused solely on editors who have failed.

5) "High-level primitives"? "Use APIs as easily as if they were functions"? Honestly, sounds like using AWS services with Boto.

This is a pretty awkward headline. For a moment, I thought Google was "A Key Legal Shield for Facebook".

Sounds like you could have made your feed items REST API return the top 3 comments as well...

Maybe the lesson here isn't that GraphQL is a magic bullet, but that designing your API for your business needs solves a lot of frontend complexity (even if it's not pure "REST").

Or just recompile Chromium with a few changes ;)

Worth mentioning that Semantic has some first-rate React bindings:

https://react.semantic-ui.com/

They're really a joy to work with. My one beef with Semantic is that it could be easier to make themes. I know that someone is currently working on a theme generator site like Bootstrap and hopefully that will be a nice step forward.

> S-Class threat

Is that a Worm reference?

Brazil does tit-for-tat and practices complete reciprocity :)

Shortly after 9/11, the USA required Brazilian tourists to use a fingerprint scanner. A Brazilian judge made a rule for American tourists to do the same:

http://www.nytimes.com/2004/01/10/world/us-and-brazil-finger...

It was a huge mess at first because Brazil hadn't required any other countries to do it in the past. I suspect that customs threw away the fingerprints at first (it was done with ink originally), but it's done digitally nowadays.

Brazil does this for all countries. American tourists, for example, have to pay $100 for a visa because Brazilians need to do the same in the U.S.

To this day, it's considerably easier for Europeans to enter Brazil than Americans. While the U.S. hasn't rescinded the fingerprint law (that I know of), it's possible this policy prevented escalation...

Now let's see who learned from the last major outage 200 days ago :)

One good example is joining to a foreign data wrapper (FDW). Oftentimes, PostgreSQL can freak out about this because the statistics might be off/vague. So instead of making a small query to the FDW, it will do a full table scan :S

A subquery explicitly tells the database "hey, don't get the whole FDW, just this part that I want"

My docker-compose always has these three containers: Node (for server side rendering), Python (for APIs) and PostgreSQL.

For the frontend, I use React + Redux + React-Router + Redux Sagas (I like starting with a modified version of ReactGo: https://github.com/reactGo/reactGo).

For the API, I use Flask + SQLAlchemy.

I've been thinking about replacing Python with something more strictly typed (Python 3's hint are a good step, but not enough IMO). However, SQLAlchemy is so great I can't imagine developing without it :)

This is great! I was looking for something like this for a while.

You guys should make the search bar a little more prominent. Took me a while to find it!

Old submission with more comments here:

https://news.ycombinator.com/item?id=4969041

I disagree.

True, the average sportsfan only watches whole games of their favorite teams.

However, people love highlight reels. That's why Sportscenter is so huge.

Unfortunately, ESPN is moving more and more towards "personalities" and gossip and whatever. Just give me the highlights on loop. That way, bars, restaurants, people in their own homes will have it on in the background constantly.

EDIT: Sure, they need to do more content on the web and on-demand or whatever. But their core TV programming should be less TMZ-y. I don't care what athletes did on vacation.

Moat | Engineers, PMs, Designers | NYC, SF, Sydney, London | FULLTIME, ONSITE

Moat is an analytics startup with products in two areas:

1) Analytics

Moat Analytics measures content and advertisements for many of the most trafficked websites on the Internet. Most new ad deals require third party measurement and for many of the top brands and websites, Moat's metrics are the go-to. We were one of the first companies to begin measuring ad viewability and we helped make these metrics a standard in the online ad industry. We handle over 19 billion impressions a day and tackle large scalability problems every day.

2) Search

Moat Search tells you who's advertising where online. We give advertisers, publishers and other adtech companies an overview of the entire online ad ecosystem (kind of like the Bloomberg of the ad world). Our customers can see their competitors' ad campaigns, find prospects by seeing the clients of similar companies or see trends in the industry before anyone else. We have a free product, moat.com and a premium product, Moat Pro. It's great to work here! I've been here for about four years and everyone's really talented and the problems are interesting.

We recently raised $50M and we're still growing very quickly:

https://www.wsj.com/articles/moat-raises-50-million-to-help-...

We're hiring pretty much across the board - engineers, PMs, designers, recruiters, etc. Both technical and non-technical openings can be found at http://moat.com/jobs.

The interview process involves a short coding assignment, 1-2 phone interviews and onsite.

Questions? Email me at rodrigo.menezes <at> moat.com

Looks faster than an SSD to me. From the FAQ:

"Q4: Will Intel Optane memory also accelerate an SSD? If so how much?

A: Yes. Intel Optane memory can be used to accelerate any type of SATA-based storage media, including SATA SSDs, However, the performance benefit of adding Intel Optane memory will be greater on slower storage devices like an HDD versus a relatively faster storage device like a SATA-SSD. Additional performance data is forthcoming"

http://www.intel.com/content/www/us/en/architecture-and-tech...

Moat | Engineers, PMs, Designers | NYC, SF, Sydney, London | FULLTIME, ONSITE

We're an ad analytics startup that's been roughly doubling in size every year for the past 4 years. We have products in two areas:

1) Analytics

Moat Analytics measures content and advertisements for many of the most trafficked websites on the Internet. Most new ad deals require third party measurement and for many of the top brands and websites, Moat's metrics are the go-to. We were one of the first companies to begin measuring ad viewability and we helped make these metrics a standard in the online ad industry. We handle over 19 billion impressions a day and tackle large scalability problems every day.

2) Search

Moat Search tells you who's advertising where online. We give advertisers, publishers and other adtech companies an overview of the entire online ad ecosystem (kind of like the Bloomberg of the ad world). Our customers can see their competitors' ad campaigns, find prospects by seeing the clients of similar companies or see trends in the industry before anyone else. We have a free product, moat.com and a premium product, Moat Pro.

It's great to work here! I've been here for about four years and everyone's really talented and the problems are interesting.

We recently raised $50M and we're still growing very quickly: https://www.wsj.com/articles/moat-raises-50-million-to-help-...

We're hiring pretty much across the board - engineers, PMs, designers, recruiters, etc. Both technical and non-technical openings can be found at http://moat.com/jobs.

The interview process involves a short coding assignment, 1-2 phone interviews and onsite.

Questions? Email me at rodrigo.menezes <at> moat.com

How can you use Cloudfront to point to multiple buckets? I'm pretty sure each origin needs a path and Cloudfront serves the first path that matches.

A reddit thread mentions that idea: https://www.reddit.com/r/science/comments/12nls5/speed_kills...

Moat | Software Engineer | New York City | FULLTIME, ONSITE

Moat is an adtech startup with products in two core areas:

1) Analytics

Moat Analytics measures content and advertisements for many of the most trafficked websites on the Internet. Most new ad deals require third party measurement and for many of the top brands and websites, Moat's metrics are the go-to. We were one of the first companies to begin measuring ad viewability and we helped make these metrics a standard in the online ad industry. We handle over 19 billion impressions a day and tackle large scalability problems every day.

2) Search Moat Search tells you who's advertising where online. We give advertisers, publishers and other adtech companies an overview of the entire online ad ecosystem (kind of like the Bloomberg of the ad world). Our customers can see their competitors' ad campaigns, find prospects by seeing the clients of similar companies or see trends in the industry before anyone else. We have a free product, moat.com and a premium product, Moat Pro.

We recently raised $50M and we're still growing very quickly:

https://www.wsj.com/articles/moat-raises-50-million-to-help-...

Both technical and non-technical openings can be found at http://moat.com/jobs. Among other things, we're looking for frontend/backend/fullstack engineers, devops engineers, and security engineers.

The interview process involves a short coding assignment, 1-2 phone interviews and onsite.

Questions? Email me at rodrigo.menezes <at> moat.com