258 karma · joined August 5, 2020
Planes don't fly by flapping their wings either. It's totally possible we will construct a super capable artificial system that only vaguely resembles the human brain.
Personally I think if we managed to create a 10 times more sophisticated GPT-3 (instead of 2048 tokens it looked back 10k+ tokens) we might get pretty close to a novel writing AI.
I really find it hard to understand why people are optimistic about the impact AI will have on our future.
The pace of improvement in AI has been really fast over the last two decades, and I don't feel like it's a good thing. Compare the best text generator models from 10 years ago with GPT-3. Now do the same for image generators. Now project these improvements 20 years into the future. The amount of investment this work is getting grows with every such breakthrough. It seems likely to me we will figure out general-purpose human-level AI in a few decades.
And what then? There are so many ways this could turn into a dystopian future.
Imagine for example huge mostly-ML operated drone armies, tens of millions strong, that only need a small number of humans to supervise them. Terrified yet? What happens to democracy when power doesn't need to flow through a large number of people? When a dozen people and a few million armed drones can oppress a hundred million people?
If there's even a 5% chance of such an outcome (personally I think it's higher), then we should be taking it seriously.
Give it 10 years :) GPT-10 will probably be able to replace a sizeable proportion of today's programmers. What will GPT-20 be able to do?
Some quotes:
> I realized quickly that the incentives are all wrong if what we want is people who will think hard about humanity’s pressing ethical dilemmas and who will suggest intuitively appealing solutions.
> Since almost all ethicists are academics, they have to publish, and in order to publish you have to be novel, and since the basic principles of ethics are little changed for millennia the incentives to do thorough homework on the basis of principles which are widely understood and accepted is not great.
> Furthermore, if you decide to be a utilitarian, then basically all ethical issues will boil down to cost/benefit analyses which you have to outsource to technocrats, so your unique expertise as an ethicist will be worth little.
There is zero reason to continue to have such a complicated test for taxi drivers when satnavs are so effective, all it does is raise costs for riders and make it harder for people to become drivers.
The second is the Caledonian Sleeper that goes from London to Inverness in the Scottish highlands. This one is ridiculously expensive. I’ve never seen tickets that cost less than £300 for a lie down seat, which is 8-10x a typical airfare 3-4x a typical seated train fare. Probably will never travel on it but I’ve always wondered why it’s so expensive. If demand is so high, the why not increase supply by adding an extra train?
National security for one; it times of war no one can starve your population into submission by cutting off shipments of food into your country. Your crops are also more resilient to pestilence and disease if grown in a controlled indoor environment.
All this makes it a worthwhile line of exploration, no?
Some interesting bits of information:
- People do work less to some extent, but the reduction in working hours is concentrated in teen years and old age (65+).
- People seem to like work, will continue their jobs even if they win the lottery.
- Rich people (top 1%) now work longer hours than poorer people.
1/ The key thing for getting to L5 is to take on large problems (usually 3-6 month long efforts), figure out how to solve them, and ship them successfully. You can do this by leading a small group of people (2-4 engs), but also by working as an individual, so I don't think leadership skills in that sense are required for L5.
2/ Usually managers are quite good at coaching for this transition (things get harder going from L5 => L6 and further on). Try to find a team that is seeing some growth and with a manager you enjoy talking to. Managers with some experience (2-3 years) are better at figuring out what gaps you need to fill to get promoted.
3/ Also try to figure out what type of team you will be successful in. For introverted people often product teams are not a great fit as they require tons of coordination to ship anything: you might have to work with a designer, a content strategist, a product manager, and a data scientist for a typical L5-scope project. Infrastructure / backend teams can offer better opportunities for people who want to grow as individual contributors. I know many senior engineers (L6+) in infra teams who aren't tech leads leading large teams -- they are simply strong engineers who can solve complex problems on their own.