422 karma · joined January 13, 2024
What are people using 1M context window for?
Are developers that use a "high level" language like C++ also doing nothing because the machine did all the work of compiling to assembly and machine code for them? Nothing to celebrate and no honor?
Have you tried refactoring or porting codebases larger than a million lines of code pre-gen-AI and again post-gen-AI? It's night and day difference. One would be insane to schedule a team on 8 months worth of grunt work porting from one language or framework to another which can now be done by 1 person in 4 weeks.
Of course the person driving it has to tell it exactly what to do and has to have the requisite knowledge to understand how to effectively structure or fix the software. Maybe new developers don't build this skill so easily anymore. But I don't see why a strong developers skills would atrophy in this case though unless they just never use their knowledge and never give instructions to the AI.
To developers speaking of skill atrophy: are you still making sure that when using LLMs you are actively exercising skills like system design, debugging, reviewing for clean code and just in general doing effective code review? If you are doing that, why do you feel skill atrophy? And if you aren't doing it, why not? What about LLMs prevents us from exercising these skills?
The bubble of contacts I have on Facebook seems hell bent on "educating" everyone that all AI is harmful and that anyone who uses AI, be it someone who has never wrote trying to make a poorly done book, or be it a professional using it for red teaming, is horribly, horribly uninformed and lazy and needs to be educated.
They have a 2 years out of date mental model of what AI is capable of and they link you things about how it has trouble counting the r's in strawberry or their other common one is water usage. If you point out that they are grossly misinformed, that AI is capable of massive increases in happiness and that now I have more time to spend with my kid even though I have a busy job, and that 1/15th the water usage of residential lawn watering is a lot of water, but it's still 1/15th of what they use on their lawn... they double down and are incapable of resolving their internal conflict. They continue to use the AI generated platform to post messages going through AI algorithms to "educate" you about AI. I don't know why I still log into Facebook.
Maybe for a non tech company yes they cannot navigate anything better due to user expectations, but in my experience those companies usually have support for Mac and at this point I'd rather have that if forced to choose between it and Windows.
So maybe let me simplify my question: If I set up both a copy of a database with values encrypted by CipherStash, and an application server connected to it, and the application server has enough access to do queries on sensitive data (eg "WHERE sensitiveField = ?", pretend it needs that for a migration), and a developer has root access on the application box while it's running, and a gdb session connected to the app, can they see any sensitive data or no?
If they can't, then that's genuinely cool, and I probably need to look into the workings a bit more!
> We're explicitly not claiming to defend against an attacker who fully owns your running application with valid credentials.
and dandraper says:
> I was CTO [...] and the engineers all had access to patient data. They needed DB access [...] but not access to the sensitive values > [...] > CipherStash solves the following: > * Hide sensitive data from direct database accessors
So putting these together is this implying that a developer who wants to test things on a large data set is given access to the database directly, but not access to debug the application? Surely for example if they could load the app in a debugger, step through it, and execute arbitrary code (eg. if they are developing on it) that includes "fully running the application"? So are you saying that scenario is not secure?
If so then I'm struggling to see how a developer would use this realistically. As a dev how am I supposed to work on an application without access to be able to change the code (assuming here then that "change the code" means I can also add a statement that dumps a decrypted value to the log)?
If the security level we want is something like "devs need to be able to test migrations work on the actual data" then why would I use this instead of just NOT giving direct db access and having an audited environment spin up a db copy and container and just output the logs of whether the migration worked, without access to query the db directly. If I do that then nobody needs direct db access right? But then why would I need CipherStash?
Seems pretty brutal to me though.
My understanding is that now with this workflow I will pay the same amount but get much less usage before getting to 100% for the week. How is that not bad?
Questions:
- rendering capabilities of this seem like it should also be able to handle 2d well, or am I mistaken? every solution I see for getting high quality 2d images or rasterization in terminal is all pretty bad. Could this do better than other solutions or is there a fundamental limit being hit somewhere?
- What happens with ssh given that this is gpu accelerated?