468 karma · joined November 27, 2012
Booth.ai (YC W23) Prev. Standard.ai, MIT
http://nicklocascio.com/
I have been building an OSS self-hostable agent infra suite at https://ash-cloud.ai
Happy to trade notes sometime!
On write amplification — we persist at the message level, not per SSE chunk. The sandbox's workspace filesystem (claude code's native jsonl files) is the source of truth for resume, and the DB is for queryability, tracing, etc - so fire and forget works fine here.
With an agent I know if I write once to CLAUDE.md and it will be read by 1000’s of agents in a week.
Can we replace the link with the actual blog post that doesn't include/promote KaraVideo? https://openai.com/blog/sora-first-impressions
These sort of devices are nuisances with very low positive utility, and there is plenty of precedence for banning them.
TFA argues that digitizing one self inevitably leads to two copies, and the digital one is not real.
Let’s take a step back and start by replacing/simulating one neuron digitally. Is this a new you? I doubt TFA would argue so. Now replace 3,000 neurons every second over the course of a year and now your entire brain has been digitized. At which point did you stop being you?
The options are, 1) every second you are a new you, with or without digital replacement, 2) every second you are the same you with or without digital replacement 3) every second you are a new you with digital replacement but the same you if you don’t digitally replace. 4) some arbitrary % that feels right like 50%.
Option 3 hinges on a special differentiation between digital and chemical computation, which is at odds with fundamental properties of Turing Machines. Option 4 is as hand-wavey as it gets. Options 1+2 while they seem very different, ultimately can be treated as functional equivalents with slight philosophical differences.
There are real debates to be had over the morality of mind uploading and the very real risks of doing so, and many great sci-fi short stories covering this topic. Unfortunately, this article is too caught up on its hot take to make room for a proper consideration beyond its knee-jerk reaction.
Side note: I worked with Kyle a few years ago on the MIT-MGH Deep Learning for Mammography project. I'm glad to see his work + brilliance being recognized.
1. CNN's are used fairly commonly for sequence tasks nowadays. Convolutions can be 1D after all. 2. It's also possible the previous comment was referring to using 2D convolutions on the spectrogram of the audio, which is a common approach. 3. Neural networks are capable of more than classification. Scoring is a regression task which is common application of neural networks.
https://www.bloomberg.com/news/articles/2017-06-23/google-wi...
Though I'm guessing that they are only now okay giving up on email data because they have so many other sources of tracking your behavior.
Founded + lectured MIT's deep learning course (6.S191), contributing writer to O'Reilly's Fundamentals of Deep Learning book, deep learning consultant for Fortune 500.
Down to chat about and give advice about anything in the machine and deep learning space! Interested to hear what you're working on! :)
I'd also recommend that the author remove the attempt at being edgy at the end with the snide reference to the reports of sexual harassment at Uber. Especially the cheeky "too soon?", which simultaneously acknowledges the gravity of the situation for the victims while also dismissing it entirely in favor of an attempted joke.
Really looking forward to a follow-up where they explore 2.2.4 further. Sampling examples which provide maximal information game seems like it could result in another huge reduction in the amount of human oversight necessary. Could see an adversarial scheme which could learn to sample these examples optimally from the manifold. This kind of thing is powerful in human learning of complex tasks to ask for clarification or feedback in specific places of uncertainty.
With small amounts of data, transfer learning is the most effective approach. There's a great tutorial on retraining inception for your own categories in TensorFlow: https://www.tensorflow.org/how_tos/image_retraining/.
Check out: