HNHacker News
TopNewBestAskShowJobs

pramsey

368 karma · joined July 23, 2015

submissionscomments
pramsey··on Features I'd Like in PostgreSQL
update pg_index set indisvalid = false where indexrelid = 63514;
pramsey··on 72-year-old Congressman pursues a Master's in AI
Article says he's working on multi-variate calculus now, which implies he was able to dredge up enough of his 50-year-old knowledge of basic calculus to even understand what the teacher is saying. Impressive.
pramsey··on Self Hosting a Google Maps Alternative with OpenStreetMap
Valhalla in particular in an in-memory router, so it's holding the whole transportation graph in memory. Not sure about the tiling and geocoding pieces. Most organizations with a "need to serve the world" requirement presumably don't balk at buying all-the-RAMs. Amazingly, the max-RAM-in-machine number has grown faster than the data-in-the-world number, and just being memory bound is a perfectly reasonable design decision, given the performance and complexity wins.
pramsey··on Postgres Insider Terminology
Yes! Actually, I was thinking "WAL" is constantly thrown around without explanation too.
pramsey··on I’m taking some time away from Comma
Nice to know, in this dark age, there are still true Heroes walking among us.
pramsey··on Datastream for BigQuery Preview
No support for geometry or ranges, alas! "Datastream doesn't support columns of the Geometric data types or Range data types. The values in these columns will be replaced with NULL values."
pramsey··on Show HN: Simulate dollar-cost averaging in any mix of stocks
Good point! I guess the prudent FAANG engineer would buy a total market fund and then short a portion of their employer to net out the overexposure. Would sure feel odd though!
pramsey··on Learn Postgres at the Playground – Postgres compiled to WASM running in browser
Also, you can `CREATE EXTENSION postgis` on it, and all that works too!
pramsey··on Postgres Indexing: When Does BRIN Win?
You can check if your data remain correlated after your updates. It's possible they do: SELECT correlation FROM pg_stats WHERE tablename = 'mytable' AND attname = 'mytimestamp';
pramsey··on Ask HN: Good pub/sub setup for personal projects?
I had a good time with the pq module for a pgsql/python [1] queue. There's a certain brutal simplicity to just having one persistent process, the database, to manage.

[1] https://pypi.org/project/pq/

pramsey··on In Defense of OpenStreetMap's Data Model
Right? The emotion of the response seems completely out of scale to the ambition of the reform proposed. "Maybe polygons?"
pramsey··on In Defense of OpenStreetMap's Data Model
1000 times yes! I am a spatial data expert but only a some-time OSM editor and I still have yet to figure out how to create a polygonal feature more complex than a single building footprint. The theoretical advantage of a unified topology model of just nodes/edges where polygons and lines share core geometry is nullified by cultural rules that say "don't do that" to editors (I had a bunch of parks that shared a boundary with a road reverted with nasty notes). The current setup is not just hard for processors, it's hard for non-experts to understand and therefore a higher barrier than a simple polygon model would be.
pramsey··on Instant Heatmap with pg_featureserv
Yes, a postgrest container would have also worked just fine for this one.
pramsey··on Instant Heatmap with pg_featureserv
The app is built with containers running inside Postgres. Wasn't sure whether to lead with the cool map or the cool tech.
pramsey··on Postgres and Parquet in the data lake
GeoParquet just embeds the geometry as WKB, so getting PostGIS geometry is as simple as going "SELECT geom::geometry FROM my_parq_fdw_table". The spec doesn't yet have anything to say about how to get a good spatial sort or carry out a spatial filter, so it's all pretty ad hoc on that end. Thanks to ogr2ogr, generating a GeoParquet file is now pretty straightforward.
pramsey··on Postgres and Parquet in the data lake
Agg pushdown is a thing in FDW, I hadn't really thought about the extent to which pulling rows into PgSQL and then summarizing them is a waste of time. I imagine actually implementing agg pushdown in the parquet_fdw might be too much to ask of it (basically writing part of an execution engine in the FDW) but boy it is an interesting thought, since so much data lake querying is aggregation.
pramsey··on Postgres and Parquet in the data lake
There is the cstore extension, which is pretty much "native" (at some point these terms start to lose meaning... it's running in the same process space and transaction aware, etc.)
pramsey··on Postgres and Parquet in the data lake
Parquet is a column-based file format. PostgreSQL is a SQL query engine, and the default storage is row-oriented, but the engine can do all kinds of fun things, hence the parquet_fdw extension and the cstore extension for example.
pramsey··on Lewis and Clark expedition left a trail of heavy-metal laxatives (2010)
It was already settled, just not by white folk. In fact that would be another whole aspect of the adventure. Over each rise a whole new culture, which may or may not welcome or tolerate you.
pramsey··on What I learned as a hired consultant to autodidact physicists (2016)
There's a wonderful exploration of "crackpots" in the aptly-named "The Crackpots" by Harlan Ellison in his short story collection "Paingod" (which is excellent). https://sckool.org/paingod-and-other-delusions-harlan-elliso...
pramsey··on Postgres Container Apps (beta)
or https://crunchybridge.com
pramsey··on Postgres Container Apps (beta)
The fact that PostgreSQL is pigeon-holed as a "database" blinds folks to the fact that it is also a full-fledged integration environment. It's a place where you can bind together multiple kinds of data and multiple kinds of application.

* Use FDW connections to pull in data from all kinds of sources! Multiple databases, file formats, HTTP buckets, you name it!

* Custom behaviours in multiple languages! PL/Python, PL/Perl, PL/R!

* Read and write to web services! (PL/Python, pgsql-http)

* And now string together arbitrary containers! (pgpodman)

The way the extension system and the type system play together, it really is a very generic place to build weird integrated systems.

pramsey··on PostGIS at 20, the Beginning
There's some work to be done to make all functions parallelizeable. After that it gets harder. For large scale raster analysis, moving the processing closer to the data becomes paramount. I feel like purpose-built raster processing will always be better. Maybe something with FDW or other client/service architecture, where the database sends off the request and the bulk processing happens close to the data. Also, the row-based model of SQL sort of breaks down against raster where the model expects much much larger objects and presenting the tiled-up model to users just adds complexity without getting back performance or flexibility in return.
pramsey··on PostGIS at 20, the Beginning
I remain pretty leery of raster in the database, for the reasons you list, but the power of GDAL to reach out over networks for raster access makes me a little more excited about some raster/vector use cases. It's not a panacea, but it's something.

https://blog.crunchydata.com/postgis-raster-and-crunchy-brid...

pramsey··on PostGIS at 20, the Beginning
PostGIS is now basically the "industry standard", so most third party tools work with it, even Esri! Here's some open source parts:

Desktop: https://qgis.org

Middleware: https://mapserver.org, https://geoserver.org, https://mapnik.org, https://github.com/crunchydata/pg_tileserv, https://github.com/crunchydata/pg_featureserv

Web UI: https://openlayers.org, https://leaflet.org, https://www.mapbox.com/mapbox-gljs

pramsey··on I wasted $40k on a fantastic startup idea
It felt like there was a missing chapter!

Consumers don't see the value at all.

Doctors see the value, but won't pay for it, because it doesn't change their bottom line.

Whose bottom line does this change then?

HMOs, insurance companies, organizations that want to improve the health of a population in aggregate. They'd pay money to have healthier people (on average) to provide the service to their docs (who see the value) to use for free.

Well, maybe; but I was hoping to see that theory validated in the last turn of the wheel.

pramsey··on 4.2 Kiloyear Event
Best book on the subject I read is Wright's "A Short History of Progress" https://www.amazon.com/Short-History-Progress-Ronald-Wright/... Jared Diamond's "Collapse" is in a similar vein, but less cleanly written.
pramsey··on The secret life of open source developers [video]
I'd guess "The Secret Life of Walter Mitty", which is actually about his daydreams, his internal secret life, not some real world life behind closed doors.
pramsey··on How We Mapped 1.3M Data Points Using Mapbox
Yes, the top-line emphasis on MapBox when all the actually useful work was done by other tools to get around MapBox API limitations. A little funny.
pramsey··on How to Get Back to the Moon in 4 Years--This Time to Stay
Even granted the technical capacity (and there seems to be a quantity of magical thinking in this article) the core question remains unanswered: to what end? We get a moon base established and then...
← PreviousPage 2 of 3Next →