HNHacker News
TopNewBestAskShowJobs

xemoka

1,220 karma · joined September 28, 2011

I'm a software developer focusing on geospatial frontend products with Sparkgeo. Opinions, as bad as they are, my own.
submissionscomments
xemoka··on Show HN: Open-source, self-hosted data management app and internal tool builder
This looks interesting, it appears to be along the same lines as baserow.io, NocoDB, Metabase and the like. Are you aiming for the same space or what makes Basetool different?
xemoka··on PostgreSQL adds support for OUT parameters in Procedures
PostgREST as others have mentioned is excellent. Check out https://supabase.io for their hosted/managed option with a few more features (and open source tools working in concert).
xemoka··on Shaded Relief Maps in Blender
My guess is that Blender's 3D rendering and lighting is far better than most GIS packages, including QGIS.
xemoka··on Shaded Relief Maps in Blender
Thank you John for your work with WhiteBoxTools, I was introduced to it when a former student of yours entered our GIS program at Selkirk College a couple years back and have been keeping one eye on it since.

You've got some really excellent algorithms and tools in WBT, I've used them to shortcut some obnoxiously long lidar/pointcloud processing with other packages.

I'm not sure that this is "less complicated" than the linked tutorial though, but some great exploration for someone who knows a little more ;)

xemoka··on Dithered images and websites (2020)
It can even be tested with the author's own tool[1] and the sample image he provides. I'm surprised the author didn't experiment themselves? Or maybe the did, and the it's the further reduced settings they decided should be used...

[1]: https://doodad.dev/dither-me-this

xemoka··on Dropbox Capture
Wow, even the Dropbox Capture landing page looks almost like Loom's...
xemoka··on Twenty percent of a picture of a dog
Yeah, I still just don't get it. That whole twitter feeds looks like a hunt for a greater fool.

This doesn't seem like artists controlling their IP, to me it seems like another method of sales that lets them tap into essentially a pineapple fund. Those who made money in crypto, sloshing around the excess, making it look bigger and bigger.

xemoka··on “Pregnant Women”
So is being an asshole. Shame we can’t meet middle way with either attitude.
xemoka··on Sriracha hit revenue of $150M a year with no sales team or ad spend
Perhaps not fancy, but French’s ketchup is much better, at least in Canada. Less sweet, more tomato flavour.
xemoka··on Zero-downtime schema migrations in Postgres using views
That is not the case. At least not in postgres 13. The owner of the view only determines if RLS is bypassed or not. If the view is owned by a different user than the table (or `FORCE ROW LEVEL SECURITY`), then the view will evaluate RLS. RLS is bypassed for the owner of the table, superusers, and users with `BYPASSRLS` attribute.

We can test this.

    ```sql

    create role data;
    create role api;
    create role bob;
    create role alice;

    create schema api_v1 authorization api;
    create schema data authorization data;

    set role data;

    create table data.user_profile (
        id int generated always as identity primary key, 
        username text,
        value text
    )

    grant usage on schema data to api;
    grant select on data.user_profile to api;

    insert into data.user_profile (username, value) values
        ('bob', 'Bob''s First Value'),
        ('bob', 'Bob''s Second Value'),
        ('alice', 'Alice''s First Value');

    create policy "Users can only see their own data" 
        on data.user_profile
        for select using (current_user = username);

    alter table data.user_profile enable row level security;

    select * from data.user_profile; -- shows 3 record, both bob and alice's

    set role api;

    create view api_v1.user_profile as
    select * from data.user_profile;

    grant usage on schema api_v1 to bob;
    grant usage on schema api_v1 to alice;

    grant select on api_v1.user_profile to bob;
    grant select on api_v1.user_profile to alice;

    select current_user; -- currently api
    select * from api_v1.user_profile; -- shows 0 records

    set role bob;
    select * from api_v1.user_profile; -- shows 2 records, both bob's

    set role alice;
    select * from api_v1.user_profile; -- shows 1 record, alice's.

    -- both alice and bob cannot access the data schema or it's contents. RLS is respected for the api_v1 schema.

    ```
Does that make sense, or did I misunderstand your meaning?
xemoka··on Zero-downtime schema migrations in Postgres using views
I was having issues with this as well; it seemed my problem was that I was creating the view as a superuser. Since view creation is essentially WITH SECURITY DEFINER (to take a term from UDFs) any user accessing the view to see the underlying rls enabled table would see all the results (since `postgres` user bypasses all RLS).

Creating a separate "data owner" and "api owner" to own the api and data schema+tables/views respectively alleviates this problem. Your API schema owner != your table owner unless you `ALTER TABLE FORCE ROW LEVEL SECURITY` in addition to just enabling it.

What issues are you running into with RLS?

xemoka··on NixOS 21.05
I still can’t quite figure out why it’s not more popular... then again, I don’t use it either, sadly, because it’s not as popular as I feel it deserves; I feel like there must be some reason it’s not used more, so in turn haven’t dedicated the time to learn it. Perhaps that’s cyclic...
xemoka··on Show HN: NocoDB – Open-Source Airtable Alternative
This looks a lot like baserow.io too; nice to see more projects like this opening up spreadsheet/db alternatives.
xemoka··on I mailed an AirTag and tracked its progress
And so does android apparently: https://source.android.com/devices/tech/connect/wifi-mac-ran...
xemoka··on Don’t we all just want to use SQL on the front end?
This is such a useful abstraction.

I love working with PostGREST and have used it quite often for quick services (e.g. a vote button on a static site), internal tools (recently a covid checkin-screener), and for Proof of Concepts (postgres+postgis-powered full text search for address lookups in a webmap without using an external geocoder).

I personally have yet to use it for something with more than 200 users, but it sounds like others certainly have successfully. Supabase (https://supabase.io/) uses this for parts of their backend.

xemoka··on SpatiaLite: A Spatial Extension to SQLite
Sort of superseded in the GIS world by the geopackage (https://www.geopackage.org/): another spatial standard built with SQLite databases. Geopackages are less about manipulation/analysis at the sql level and more about storage—the idea is you’re already using something like QGIS that can perform analysis
xemoka··on Show HN: Mito – Write Python/Pandas faster by editing a spreadsheet, in Jupyter
Right, even the headers on all the source files claim BSD...
xemoka··on Zola: A fast static site generator in a single binary
Yeah, that’s the start. And I think what I’m after is eventually on the way. I’m not sure this would quite work the way I’d like; I guess variables could be passed into the template based on path and it could request different remote content based on that— I’d prefer to be able to use remote resources just like markdown instead of a different workflow.

Again, maybe I haven’t thought about this enough yet.

xemoka··on Zola: A fast static site generator in a single binary
I run a few (well, one published, one in the works, a couple one-offs for student showcases) websites built with Zola. It's a great, little, simple piece of software.

What I like:

    * Already supports the tooling I enjoy → SCSS out of the box, django/jade-like template engine (Terra, its sister project), markdown w/ TOML frontmatter
    * Fast → build times are almost instant, dev server builds to memory and does live-reload
    * Gets out of your way → it doesn't do more than it can, yet provides enough to work
    * Builds a search index for client-side searching if needed
    * Single Binary → I can pass the executable around with the repo and installation and environments are not an issue (ruby and python are painful for part-time developers it seems, at least with my non-developer academic peers).
I like that it provides a simple base to build on. I have one site that uses webpack to generate bundles for a couple JS files to allow for modern JS (babel) → all I have to use webpack for is JS, Zola handles the rest.

I migrated our Django theme for our previous site in an afternoon. I've found that those I work with often don't really understand how formatting in a CMS will apply in the published result, and often have to go back in and edit their pages for conformance → If I have to touch it anyway, I'd rather do it in markdown myself, something I enjoy using.

I have students/interns who have picked up markdown faster than any other markup or CMS. I've tried mezzanine [^meh] and wagtail [^excellent, but heavy for our brochure-ware] in python, wordpress is a pain [^either too flexible, or not flexible enough, research interns don't easily see how complex theme interactions occur] and some others like cockpit [^neat but flexible to a fault, yet too rigid for how free-form folks want to interact with it]. Markdown is translatable, and usable in other tools: it's a great common denominator with a very low bar for entry. Students continue to use it after first interacting with it on these projects after they've left.

What I'm missing:

    * a way to build from an API endpoint instead of markdown, i.e.: point to an endpoint to get the section list, build children as pages. Then I could use content from a postgrest instance, or build it from a list of remote markdown files... (no, I haven't really thought this through very well)
YMMV.
xemoka··on Changes to sharing and viewing news on Facebook in Australia
Yes. True and fair. But how can we test the page rank algorithm “ourselves"? Who is "we" in the "we do test them"? Is the public even asking for 3rd party examinations by transparent/public organizations (or at least, publicly funded)? Seems like we only get to "test" against the live system, and third party examination seems relatively impossible. It seems like something with such far reaching and invasive results should be more accessible, at the very least.
xemoka··on Changes to sharing and viewing news on Facebook in Australia
Seems to me that’s a viable answer. How can we test an algorithm like Google’s ranking though? We can’t feed it consistent data like in a software test. It relies on too much information, and what we know about it indicates we can’t extract it out to test against it—except for results in the real world.

Not to mention Facebook’s are even more difficult. Tangentially related, remember when you could use “View As” on your profile page to see what your profile looked like to others? It doesn’t work anymore, only works for Public and Yourself; you can no longer choose the person to view as.

It’d be great to test these algorithms. We can’t. They need to be designed and instrumented so this is possible.

xemoka··on Changes to sharing and viewing news on Facebook in Australia
Right, like I said, credibility is a different problem. But at this point, we don't even get a lie from them, we get nothing. At least a lie can be checked and examined. There's nothing available at all currently.
xemoka··on Changes to sharing and viewing news on Facebook in Australia
To me, their response didn't seem to indicate that it should be directly decided by people. This is a consumer protection matter, and to stretch an analogy, like a list of ingredients on a consumable. Here we have these black boxes, and no list of ingredients, yet they drive and shape our world. A Person can't EVEN directly decide if they wanted to.
xemoka··on Changes to sharing and viewing news on Facebook in Australia
By asking them. You can't just ask an algorithm, it must be designed to show its own work. Credibility is another problem...
xemoka··on Covid: New lockdown for England as cases surge
That 400 number seems off to me. Without more information on where you've pulled that number, what I can find is that there's ~74.7k deaths where COVID-19 was mentioned on the death cert in England and Whales since January last year. They didn't seem to really start counting that until March, until that point they were just classified as respiratory diseases.

Current statistics show that there's around 1'400 deaths of those under 50 with COVID-19 listed on their death registration, ( https://www.ons.gov.uk/peoplepopulationandcommunity/birthsde... ).

Where's your data from?

> Lockdown seems to drive deaths, at huge social and economic cost, rather than prevent them.

This could easily be a reversed causality, that deaths drive lockdowns... which, on the surface seems to make sense as high deaths seem to force politicians to lockdown (either for reality or perception).

xemoka··on Show HN: Stork: A customizable, WASM-powered full-text search plugin for the web
Fuse.js (https://fusejs.io/ ) has been super simple for client side search for me, I’ve used it in a couple projects now.
xemoka··on Weather Service faces bandwidth shortage, proposes limiting key data
Huh, made with Vue/Vuex + map via VueLayers (OpenLayers wrapper). Actual radar data is coming from a geoserver at https://preview-opengeo.ncep.noaa.gov/geoserver/

AGOL (ArcGIS Online) is only providing the basemap and layer overlays (state boundaries etc), those probably come from Esri's "public" data portal and I doubt are part of the bandwidth issue.

xemoka··on Libra – a tool to browse and download more than 275 TB of open Landsat imagery
This tool has been broken for a while, the API it uses has been deprecated.
xemoka··on Show HN: DataSpeeder Instant End-User Web GUI for MySQL
That does everything from ingesting an existing database to forms? Not really, not perfectly (not that this is "perfect" either).

There's some things that get close though, like Directus (directus.io). API-wise there's PostgREST ( http://postgrest.org/ ), PostGraphile ( https://www.graphile.org/postgraphile/ ) and Hasura ( https://hasura.io/ ). Commercially there's Supabase (https://supabase.io/) which is new and based on PostgREST and their own tooling, and SubZero ( https://subzero.cloud/ ) which is similar.

There are some non-ingestion (requires you to use the frontend) headless CMS options that may also fill this space ( https://headlesscms.org/ ) if you tilt your head and squint.

This space seems to be growing, primarily on the API side, I imagine the frontend side may be next.

Currently my favorite is PostgREST and custom VueJS forms (using Quasar for "rapid dev"), but requires lots of 'bring your own' work.

xemoka··on Show HN: DataSpeeder Instant End-User Web GUI for MySQL
Well, there is Chinook ( https://github.com/lerocha/chinook-database ) which was inspired by Northwinds, available for most popular RDBMSs. I used it to teach an intro to SQL course. It has some issues, but that's to be expected (and probably ideal for real-world considerations).
← PreviousPage 3 of 11Next →