3,418 karma · joined November 9, 2018
It pains me to say this, but I agree with you on the subject of AI. I think people are wildly misusing it and creating yet another bubble. It is good at digesting and sifting through data but it's terrible at providing good solutions and people are using it for the latter. I've been actively using it for months at work specifically for sifting through large, completely unstructured documents and pull out the relevant data from them and it has done wonders. So much so that the management has invested in some beefy GPUs for the occasion. And by beefy I do mean BEEFY, coming from someone who owns 2 * 24GB VRAM nvidias for personal usage. I also feel like the day when new models become a rare and unexpected occurrences is not far.
There was a huge boom around Covid, sure, when infrastructure was clearly not ready to cope with the demand so as many people had to be dragged into the equation. There were also companies aggressively hiring tech people partially because of the demand but also to establish a monopoly. And the rise of one-online-course developer programs was the cherry on top. That was bound to collapse and Musk's campaign over at Twitter gave everyone the confidence that there's no need for anyone but a few managers and prompt "engineers". And we are reaching the "find out" part for all players involved.
If you are a tech worker with skills, then you have absolutely nothing to worry about: AI can only write trivial code which normally would be thrown at an intern - stuff like "write a function that takes in a hashmap containing key-value mappings and a second hashmap to swap out the said keys", which you will likely still need to tweak to make it safe. But for any serious or critical code, if you are relying on a LLM to do the logic for you, you are basically walking around blindfolded, holding a loaded gun pointed at your head. Sadly I know a lot of people who actively do that exact thing.
The other part is that the market is over-saturated with products that no one needs. How many more social medias do you need? None. How many more trading platforms? None. How many more messenger apps? None? Dating apps? None. Yet new, "revolutionary" ones pop out daily. Guess how many of them fail? Their marketing campaign was "blockchain" 5 years ago. Now it's "ai". My coffee machine needs neither of those, who are you trying to sell this to?
When it comes to the tech sector, people should understand that this is not a bottomless pit and it all boils down to a finite amount of people that will use your product(consciously or not). And by implications you need a finite amount of tech workers. The jobs have not dried up, it's partially normalization after the Covid hype and to a lesser degree managers thinking AI will do their tech work - the same people who have become Musk cult members. I used to work for one and guess what - the company he founded in 2017 with very noble intentions and received a really good funding is collapsing cause they are unable to roll out a product. Those are bound to fail either way.
As for courses - there are talented people who have only done a bunch of those, but they are the extreme exception and realistically most of the people who enrolled in those were simply there because they thought that's a cheap ticket to a 6-figure salary.
The second issue I see is that data is becoming widely unavailable-everything is getting blocked, crawlers are getting cut off immediately, 1000 API calls cost as much as a mid-sized flat in a European capital - the complete opposite of what the internet was supposed to be.
The third issue is the fact that people are gladly using chatgpt to answer questions on stackoverflow for example. We know how badly llms start performing when you train them on their own data... Not to mention the considerable spike in critical bugs in open source projects over the last two years-there's a good chance it a lot to do with it.
The fourth is social media-there are already tons of examples where troll farms are no longer paid workers in some dump in siberia but are in fact powered by chatgpt out some other service. And to think that I laughed at the dead internet theory when I first heard about it...
Telegram has legal obligations and we all know they haven't fulfilled them-you can easily verify that on your own: you don't need to be a government agency to do that - open telegram and use the search function, hell even the auto suggestions lead you to a ton of illegal stuff.
With vision models in the late 2010s, I was seeing AI winter 2.0 just around the corner - it felt like this was the best we could come up with. GANs were, to a very large degree, a party trick (and frankly, they still are).
LLMs changed that. And now everyone is shoving AI assistants down our throats, and people are trying to solve the exact same problems they were before, except now it's not blockchain but AI. To be clear: I was never on board with blockchain. AI - I can get behind it in some scenarios, and frankly, I use it every now and then. Startups and founders are very well aware that most startups and founders fail. But most commonly, they fail to acknowledge that the likelihood of them being part of the failing chunk is astronomically high.
Check this: a year and a half after ChatGPT came about and a number of very good open-source LLMs emerged, everyone and their dog has come up with some AI product (90% of the time it's an assistant). An assistant which, at large, is not very good. In addition, most of those are just frontends to ChatGPT. How do I know? Glad you asked - I've also been very critical of the modern-day web since people have been doing everything they can to outsource everything to the client. The number of times I've seen "id": "gpt-3.5-turbo" in the developer tools is astronomical.
Here's the simple truth: writing the code to train an AI model is not wildly difficult with all the documentation and resources you can get for free. The problems are:
Finding a shit load of data (and good data), which is becoming increasingly more difficult and borderline impossible - everyone is fencing their sites, services, and APIs - APIs which were completely free 2 years ago will set you back tens of thousands for even basic data.
As I said, the code you need to write is not something out of reach. Training it, on the other hand, is borderline impossible. Simply because it costs A LOT. Take Phi-3, which is a model you can easily run on a decent consumer-grade GPU. And even if you are aiming a bit higher, you can get something like a V100 on eBay for very little. But if you open up the documentation, you will see that in order to train it, Microsoft used 512x H100s. Even renting them out will set you back millions, and you can't be too sure how well you would be able to pull it off.
So in the grand scheme of things, what is happening now is the corporate equivalent of pump-and-dump. It's not even fake it till you make it. The big question on my mind is what would happen with the thousands of companies that have received substantial investments, have delivered a product, only for it to crash the second OpenAI stops working. And even not so much the companies, but the people behind these companies. As a friend once said, "If you owe 1M to the bank, you have a problem. If you owe 1B to the bank, the bank has a problem." In the context of startup investments, you are probably closer to 1M than 1B. Then again investors are commonly putting their eggs in different baskets but as it happens with investments and the current situation, all baskets are pretty risky, and the safe baskets are pretty full.
We are already seeing tons of failed products that have burned through astronomical amounts of cash. I am a believer in AI as an enhancement tool (not for productivity, not for solving problems, but just as an enhancement to your stack of tools). What I do fear is that sooner or later, people will start getting disappointed and frustrated with the lack of results, and before you know it, just the acronym "AI" will make everyone roll their eyes when they hear it. Examples: "www", "SEO", "online ads", "apps", "cloud", "blockchain".
Setting those things aside, I have mixed feelings about adding more hinges to laptops. In my experience the hinges have always been the Achilles' heel of laptops. Also any additional screen adds up a fair bit of weight which seems trivial until you end up stranded on an airport for 20 hours and have to figure out how to take a nap on the bench while your stuff is secure(looking at my dumb younger self who decided to buy a 17 inch Sony laptop at the end of my first year in university). And the extra screen means your battery life will suffer. I mean yeah, I have 4 monitors on my workstation and when it comes to work, they actually make sense: one for a terminal and logging, one for actual code, one for documentation and one to manage chats and music. But when it comes to laptops... I'm not so sure anymore.
2000/31/EC[2], states that providers are generally not liable for the content they host IF they do not have actual knowledge of illegal activity or content AND upon obtaining such knowledge, they take action and remove and disable access to that content(telegram has been ignoring those). Service providers have no general obligation to monitor but they need to provide notice and take down mechanisms. Assuming that their statement are correct, and they had no idea, they should be in the clear. Telegram provides a notice and take down mechanism. But saying that there are channels with +500k subscribers filled with people celebrating a 4 year old girl with a blown off leg in Ukraine and no one has reported it in 2 and a half years after it was created is indeed naive.
1. From a product perspective, this is like going to a restaurant to get dinner but having to bring your own kitchen utensils, food and cooking your dinner yourself.
2. Anything running in a browser is inherently insecure - what's the guarantee that the site where you're pasting your key doesn't have some incredibly stupid security flaw and your key gets leaked?
3. Even if there are no vulnerabilities, you're still pasting your code in a random form somewhere on the web. All it takes is an ajax call or a websocket and someone, somewhere has your key.
1. A microcontroller with a LoRa module and a motion sensor will get you a long way and it will consume little to no power. That said, you also need to make sure you have a device to either read the signal or someone in a radius of 4 to 6km is hosting a lorawan gateway. If not, I'm sure people will be grateful if you set up one yourself - to my mind it's worth it and I happen to be the only person that hosts one and covers my area of the city. Just make sure you don't enable any of the other gimmicks the microcontroller might come with - wifi, bluetooth or whatever. For instance I have a bunch of these [1] and they seem like they would do the trick for you if you pair them with a motion sensor. I need to warn you though, the documentation is appalling.
2. If you do wanna go CV - you can but it will never be low power and you will need to figure out some connectivity. If it's a raspberry pi or some other SBC with GPIO, you could of course hook up lora to it. As for the CV itself - opencv will get you there or you could train a very small yolo-like neural network - if you control the environment/lighting and they are static, you only need a handful of sample images to train it and you will get great accuracy. Like even something in the very low double digits will do the trick. Imo that would be overkill and your best bet is still the first option.
For as long as humanity has existed, whenever we feel like we've reached our peak, something happens and completely shatters our understanding. Say we have prime numbers and their occurrence is completely unpredictable - the same way Aristotle was convinced that objects come to a rest because they get tired. It's not a specific branch of knowledge, it's an outrageous claim like many have already pointed out. Could it be that math is running out of problems? Yes - in the same way that the universe might vanish tomorrow. Both of those claims are equally absurd.
[1] https://en.wikipedia.org/wiki/Charles_Holland_Duell#Everythi...
Recruiters are a mixed bag. I've had wonderful and horrible experiences(and almost nothing in between). My current job - 10/10. The one before - same - the guy was awesome and was the reason I took the offer(against my better judgment) and ultimately was the only person I liked in the company and the only one I miss. The job before that - uugh... I joined the company before the HR did and had it been the other way around, I would have turned the job down - she was absolutely unbearable. In the grand scheme of things I agree: HRs are atrociously insufferable.
First one: cloud services are expensive and come with a lot of overhead. However I do enjoy the idea of lambda/cloud functions a lot but I didn't want to rely on cloud services for them, especially since I have a ton of hardware to self-host stuff. So I built a service which piggybacks on DIND where I could add templates for such lambdas for a few languages(just rust and python cause that's mostly what I use) where I can allocate some resources and build tiny containers. In order to avoid wasting resources, they are all off by default but through the magic of what I build(management and something like a reverse proxy + container management for DIND), I can call an endpoint, which will check if there is a container to handle the requests and proxies the request and response to and from it or it will spin up the container, do the same and shut it down after a pre-defined amount of time. You could argue that I could have achieved the same with minikube or k3s but this has proven to use a lot more resources compared to a single rust binary I can run on anything x86 with docker on it. The downsides are that I can't distribute it across multiple servers so it only runs locally. But that fits my needs perfectly. There might be some people that would be interested in it but I never got to open sourcing it so I'm the only user. I've been planning to open source it "next week" for the past 2 years or so.
Second one: I love data. Specifically unstructured, raw data and I've been collecting a ton of articles from the internet over the past 2 years or so. The ingestion involves a pipeline that automatically processes them and extracts data/makes them a lot less unstructured: events, locations, timestamps, what has happened where and all that jazz. It's a long list of ml models, data transformations, validations, 3 llm's fighting each-other and a bunch of other stuff. Kinda feels like a child to me so I don't want to open source it. I know that I could hypothetically convert it into a product and make some money off it but my past entrepreneurial experiences have been very unsuccessful, I have limited time and lack motivation. So at the moment I'm simply enjoying the data getting spit out on a grafana dashboard such as this [1].
Most people have probably never considered this. It may sound like a cliche but it's far more important to educate people as well as their children from a very early age about those things than to assume that outsourcing the problem to technical solutions would somehow solve it - it won't.
However I have one or two projects that I keep kicking down the road due to time constraints which involves a rasprerry pi zero w2. The reason being is that it's compact, packs a decent punch and is extremely easy to power it from an 18650 battery and keep a low profile.
I'm fine with the current prices of the raspberry pis but it's hard to justify using one of them if you don't need GPIO pins or something that uses little power. My advice to the raspberry pi foundation is to stop trying to push performance and focus on features. I'd be the first in line to get a new raspberry if it comes with a battery hat and LoRa built in(the project I was referring to really). Here's another one(which ironically already sort of exists): the milkv duo. There are lots of cases when you don't need a full operating system 24/7, which would waste a lot of resources to do one-off tasks every now and then. Ideally you should be able to boot the OS from a sensor or some sort of signal, which is hooked to a very under-powered micro-controller only when you really need it, let it do it's job and then power it off. As we stand, the raspberry pi foundation largely offers the same product in different form factors with some arguably marginal upgrades, which most people don't really need.
That said, a while ago there was this[1] thread on here which helped me snatch a brand new, unboxed p40 for peanuts. Really, the cost was 2 or 3 jars of good quality peanut butter. Sadly it's still collecting dust since although my workstation can accommodate it, cooling is a bit of an issue - I 3D printed a bunch of hacky vents but I haven't had the time to put it all together.
The reason why I went this road was phi-3, which blew me away by how powerful, yet compact it is. Again, I would not trust it with anything big, but I have been using it for sifting through a bunch of raw, unstructured text and extract data from it and it's honestly done wonders. Overall, depending on your budget and your goal, running an llm in your home lab is a very appealing idea.