Have you my chance come across a good SQLite vector extension that works in the browser? I haven't found one yet.
30,161 karma · joined March 17, 2008
Working on sync engines, PGlite, and Tanstack DB at Neon/Databricks. Previously co-founder ElectricSQL (acquired by Databricks).
sam dot willis at gmail dot com
samwillis.co.uk
Twitter: @samwillis
Have you my chance come across a good SQLite vector extension that works in the browser? I haven't found one yet.
I believe this route with WASM is the correct one. WebSQL would have been tied to one single version of SQLite, with no alternative implementation.
With browsers adopting safe low level APIs like WASM and OPFS it enables a much broader range of databases to be available in the browser. We already have SQLite, DuckDB and various vector dbs.
OPFS is still under active development, but with some of the changes coming to it in 2024 it's going to become significantly better to use.
All of this is part of the enabling tech behind "local-first" apps. I'm somewhat biased as I work on ElectricSQL (we sync Postgres on a server to SQLite in the browser), but 2024 is going to be a supper exciting time for local-first software.
I'm expecting raw SQL to replace the API for a whole class of apps.
Throw in an event sourcing architecture for server side processing and you have a single SQL based API for all operations.
"He also noted that the original terms call for Adobe to pay a $1 billion break-up fee even if the deal falls through over regulatory issues."
https://www.barrons.com/articles/adobe-stock-figma-acquisiti...
I wander if that will make its way to early employees who were hoping for a liquidity event.
A number of years ago there was a demo of a technology where they mixed (something like) iron filings in the asphalt. By slowly driving over it with a massive electromagnet they could heat the asphalt from within, helping to fix any small cracks before water ingress could cause a larger problem.
But everything about road tax needs to change with the reduction of fuel duty due to electric cars. The public haven't seen this coming yet, but it's going to be a difficult transition.
Now increasingly as older GPs who are partners in prentice's retire they sell their practice to privet equity backed groups. GPs don't want to buy into a practice anymore.
The result of this is significantly worse care and service as the PE backed groups try to extract profits from the system. It's an attractive deal for PE, guaranteed income based on patent list size, and an opportunity to cut costs to make a profit.
The Apollo guidance computers had "several tens of thousands of transistors"[0], we now have 19 billion in our pocket!
0: https://www.aei.org/technology-and-innovation/apollo-11-mank....
We are holding a first ever Local-first Software London meet-up on the 18th October, at IDEALondon, near Old Street. The idea is to get together, chat local-first and have a few talks.
We have an awesome lineup of talks:
- "Everything's better with Friends" from Sunil of PartyKit
- "Designing the DDLX - a local-first database rule system" from Paul Harter of ElectricSQL
- "CRDT challenges in the wild" from Russell Brown of Ditto
- and an into to Local-first from myself.
Do register to let us know you're coming.
My understanding is that the teachers that take on these roles are incredibly well trained, understand the responsibility, and know how to be both discreet and keep things privet. I believe a lot of the information available through this app was already being made available to the safeguarding leads in schools.
Challenging the use of this app is good, that's the role of these origination, checks and balances and all that. We need to be sure it is a net benefit for all involved. There is no denying though that if it helps teachers in safeguarding children that is a good thing.
Quite right, the latency should be low single figure ms. There is actually a slight bug in how that latency is calculated on the demo and includes an extra render tick, I was digging into it earlier but didn't get a chance to push a fix yet.
The CouchDB/PouchDB pattern is how I originally got interested in local first, they are such a good tool, but having the full power of Postgres and then SQLite on the client, I believe, is a real game change.
Sounds like Electric could be a really good fit for your use case. If want any advice join the Discord and we are happy to help out.
The WASM module is just a standard build of SQLite, about 1.1mb - there are many landing pages 10x that size - and something that we think is easily justifiable for the types of apps that people can build with Electric.
In terms of use cases, there are numerous, broad-ranging possibilities - anything from a replacement for GraphQL or a REST API in your existing stack, all the way up to building large collaborative apps. Our intention is that you can build collaborative tools similar to Linear, and we do actually have a demo of this sort of thing (http://linear-lite.electric-sql.com), but it’s certainly not limited to that.
Electric is designed to support partial sync, and so you don’t have to sync your whole dataset. (Note that this is feature is under development and not yet public)
There are limitations on how much data a browser will store for an individual site, so the number of rows you can sync will depend on the shape of your dataset. Finally there are also some performance considerations with WASM SQLite, this is something the SQLite team are working on in collaboration with the browser developers, particularly with the development of the new OPFS apis which we plan to support as they mature.
So, thousands of rows are definitely viable, and we have that working with our own internal development tests. Hundreds of thousands or millions may cause issues right now, but are something we do want to support.
I'm sure that in the not too distant future (a few years at most) we will be happily running these on customer level hardware.
I do wander if companies working to develop these type of revenue models truly think it's a long term structure?
Was fun, I was playing code golf with myself. Sadly seem to have lost the code and I didn't use it in the end.
It would probably have been possible to go smaller than I got it by combining it with a sudoku solver, so stop packing positions once it's solvable. But life moved on.
Now here we are 30 years later and I'm typing on a laptop running on a ARM (née Acorn RISC Machines, then Advanced RISC Machines), I have an ARM in my pocket, another in a tablet in my bag. My wife is next to me on an ARM laptop, she's also got an ARM on her arm... we're listening to music on a wifi speaker running on an ARM. There are probably 30-40 ARMs in one way or another around our house. Amazing really.
"'Mystery company' buys land worth $800M near Travis AFB, raising concerns" - 114 points - 35 days ago - 170 comments
https://news.ycombinator.com/item?id=36816387
There were all sorts of rumours, and concerns due its proximity to an important military base. I can't imagine the government and military not knowing that this prominent group were behind it.
When we except that both what we create and ourselves are transient, life become better. Concentrate on the now.
--
Edit: not sure which reply to reply to, so commenting here.
My badly made point was that trying ourselves to insure the longevity of something we create is not the best use of our time and resources.
If we create something of value, and it means something to other people, it will spread, and it will be saved for the future and future generations.
Society saving things for the future is essential, and we generally do a good job of it.
It's a good location for this as it's quite flat, very few hill, and those that exist are more like a hump.
In row oriented, each cell for each row is next to each other in memory. Think traditional CSV files, each row is a line in the file. To sum a column you have scan the whole file and all data for all columns.
> In early celebration of the forthcoming v1.0 release, we've renamed MRSK to Kamal, after the ancient Arab navigational tool (and to celebrate our complete cloud exit with a couple of vowels ). Will record a new video shortly. New website is live at ->