Hacker News Reader

Why not convert the data from csv to json and serve the json blob from your object store or CDN (if this solution is immutable)? No need for the API interface, just gzip the json blob and have the client retrieve it entirely.

No need for an app, app server, and the json can be cached with the rest of your content. Unless I’m missing something?

View on HN

Size. The San Francisco trees database is around 50MB, and I've successfully tested it with multiple GB sized SQLite databases.

this was a key answer to a good question. I think you should emphasize that part (handling large data sets) as a key aspect of datasette

If you're serving the entire JSON dataset, sure, but this solution allows you to do server-side filtering.

Reply on news.ycombinator.com