Using GPUs to Speed Through the 1.2B Record Taxi Dataset
mapd.com
mapd.com
[1] https://www.youtube.com/watch?v=LC_sx6A5Wko & http://www.videocardbenchmark.net/gpu.php?gpu=Tesla+C2050
MapBox is an active and respected participant in the OpenStreetMap project and uses our data in some of its products, but that is it.
Here is the Titan X link http://bit.ly/2e6C3Gg
Here is the K80 link: http://bit.ly/2eiIwvp
However, I'm suspicious of the numbers in those articles since the author lists only 4 data points in each trial and doesn't mention the stdev in his measurements. One of his measurements was .964 vs .891 so it looks like the Titan Xs were 90% as fast as K80s if the numbers can be trusted.
And mini-disclaimer: Graphistry is a related platform focused on scaling & automating investigations. Part of that is a GPU compute stack the we started building around the same time as MapD, though we're not in the database business. E.g., our customers will generally use us to look across multiple other systems that already feature high-availability, long-term storage, and scaleout querying for TB+ storage. As some examples: SQL engines, Spark, Splunk, Datastax, and various graph databases.
https://aws.amazon.com/marketplace/pp/B01M0ZY2OV?qid=1475606...
If you really have a tight budget and need to use gamer cards as workstation cards (e.g. a two-person startup that needs to crunch things on 4 GPUs), find yourself some aftermarket coolers, preferably liquid cooling.
With the enormous caveat that you need to have a low latency to their server to get this illusion of client-side rendering. Considering that they only have this cluster of K80's close to them, geographically, and not a number of clusters spread out globally, this isn't a usable example in much of the world.
Now, I don't expect them to roll out K80 clusters world-wide just for the sake of a demo, but it's still pretty important.
Pretty cool but a different animal.
- React / Redux / mapbox-gl
I always look at the data table implementation to see how far people go. And here they made their own implementation based on d3.
Here's the sources for those curious: https://github.com/d8d/mapd-sources/tree/master/out
Why wouldn't they be hosting this in compressed form. A quick shot through pigz has it down to < 50% original size.
Slightly different. We have appended all of the data from Factual as well. This includes the location of every business in NYC.
It tops off at 192GB (8 x 24GB). Assuming in a couple of gens (#slots & gpu mem) will put it in 1TB range.
HN effect?
I have to say it seems your pricing for such a new entrant and before having built share, is bound to attract very stiff newcomer competition. "Interesting" business model.
You can install this on AWS or on your own infrastructure (I run this on my laptop for example).