We're creating a new top-level product group at Meta focused on generative AI
facebook.com
facebook.com
It's so crazy but Mark's personal boredom or interest in either of these could swing the whole direction of computing one way or the other.
I do think VR could be the ultimate application of generative AI - one of the biggest bottlenecks at the moment is how expensive and tedious it is to make the 3d content necessary to fill out expansive VR worlds. It could also be central to actually making viable things like codec avatars which currently are stupendously compute intensive but perhaps don't need to be if you can generate the output using AI instead of actually coding and decoding it at the other end.
Seems uncharitable. He's making a long term bet. Nothing wrong with that. People would complain if they never pursued any new avenues.
> I do think VR could be the ultimate application of generative AI
Then it seems a good thing for them to pursue then?
The Softbank way!
I don’t mind when rich people make huge bets with money that’s within their control.
Toolformer: Language Models Can Teach Themselves to Use Tools
Possibly more like "people in our VR spaces aren't finding many other people to engage with. Let's generate AI partners that are hard to tell from real people to make up for that."
Even if Zuck wanted, his team doesn't seem to be able to pull that off, be that of tech limitation or just too many value-extract in the team. It doesn't seem XR is the reality. at least from forseeable futures.
[1]: https://twitter.com/ID_AA_Carmack/status/1626389610635923457
He's talking about text and possibly video here, not VR.
Thats tells you a lot about whats going on and what kind of people work inside there.
They seem to be a dead man walking.
I hate seeing these comments in HN. No substance. Just saying whatever to jump into the FB hate bus.
There's a difference between running a research lab and a product organization. I used to work in a research lab (Nokia Research). Lots of cool research. But product divisions routinely ignored what we were doing. Not invented here, not a priority, we're busy moving deck chairs around on our Titanic, etc. Very little industrial research translates into customer/product/share holder value.
Facebook, like several other big companies, pays a lot to keep some very smart people on staff. They constantly come up with new stuff that they publish about and that also result in patents. That's not the issue.
However, from there to product features is where it goes wrong. Most of Facebook's product portfolio hasn't changed substantially for quite some time. And they haven't really launched any noteworthy new stuff either. Publishing a paper doesn't really count. It's nice and it will no doubt help other companies to succeed where Facebook is clearly struggling to succeed.
Most large companies struggle with this. A lot of former industrial research labs have either disappeared entirely or became a shadow of their former selves. IBM, HP, etc. used to do lots of blue sky research. Xerox Parc was a big deal and they obviously failed to productize. But of course inspired Apple and quite a few others. It's a tough topic. I don't think many companies have figured this out.
There are positive examples of course but mostly the return on investment for open ended research in a corporate setting is not as high as it should be considering the valid research that gets published and then fails to get monetized by the companies doing the research.
OpenAI, is the smart counter move. Spin off a company, fund it, and then license back the technology. MS seems to have learned from it's past efforts in MS Research.
It’s also a fair criticism of most of big tech wrt AI, and a lot of AI/ML: there’s a lot of cool-sounding R&D, but so far there are few (arguably no) resulting products.
Maybe we’re starting to see that change, maybe not. Bing/ChatGPT is promising, but ... nascent. A lot of this has echoes of the self-driving revolution.
Whenever I read techno-optimists on this site, I cannot help but think back to 2014-ish when they all predicted that there would be no truckers in 5 years and dramatic changes to infrastructure to support a wave of self-driving vehicles.
The inevitable nature of large corporations is to become bureaucratic and slow, yet many of them exist for decades without being innovative. It's sufficient to just buy out whoever is innovative in the market - Microsoft just bought into OpenAI big time. Other than incrementally developing its 40yo operating system Microsoft copies AWS, Netflix for games, Sublime Text and Macbooks while throwing some random cash at garage projects that amount to effectively nothing that can exist without subsidies (Hololens).
They are talking about actions in the last year or so.
Meta's open source projects that they own are maintained now by eager volunteers, not staff.
Anybody could see how Facebook is floundering, Instagram can see the iceberg approaching, and changing anything major in Whatsapp will piss off literally billions of people.
They've cornered themselves, so now they're reaching for literally anything that could save them. That seems reasonable as a failing company, except when every action they make affects entire markets and legitimizes trends on a very shaky basis.
And now, this meta thing... :-)
That said, Air Canada (also mentioned in the article) is also investing in AI while their default online booking process is still quite bad. Last time I wanted to book a flight with a pet, the website told me to book the flight without pet, then make a phone call to tell them I would be taking a pet with me (and cost would then depend on destination) just like two decades ago.
So I decided to use KLM and booked my flight, with pet, all through the website without needing a phone call.
Security took me almost three hours to get through, and they had a byzantine system where once you got to the end of what you thought was the entire line, you’d turn a corner to find another long one, and that happened six times.
It basically devolved into a system where it was just a huge crowd standing around, and as peoples’ flights were about to board they’d get moved to the front.
It reminded me of the freakonomics episode where they talk about the LIFO queue: https://freakonomics.com/podcast/what-are-you-waiting-for/
https://www.cbc.ca/player/play/2056928835691
https://www.gominplanet.com/blog/air-canada-the-worst-airlin...
My advice to anyone using Air Canada: upon arrival to the destination, don't waste time trying to find your suitcase on the carousel (it's not there anyway) - instead, go directly to the kiosk to complain about the lost luggage , otherwise you will have to stand in line for 2 hours. :-)
Uh, ok, I thought all airports have already been doing this for decades? One time I got pulled aside because the scanner thought my chocolate bar was a bomb.
It's facial recognition.
Cryptocurrency. Voice assistants. VR.
What else?
See the open-source code repo of Meta Research. https://github.com/facebookresearch
Companies dream of creating just one of these.
Nowhere did you say that Facebook’s innovations have to be the reason the end user uses the product, or even used by the end user at all. All you said is that they have never innovated. That is the bar. And it is clearly extremely low as Facebook has done lots of innovating with products used by developers all the time.
I guess you could say that fb created some innovations, mostly in their labs, but they are not in the business of innovation
> but they are not in the business of innovation
Who in this thread claimed they are in the business of innovation or that something is innovative only if it affects their direct customers? This entire response is a strawman, plain and simple.
Once again, your clearly defined bar is, and I quote:
> When did facebook innovate?
Stick to the bar you set and be humble when it’s clearly proven to be a dismally low bar.
As much as we try to sugarcoat it, facebook is not known as a mobileUI or languageML company
Even outside of AI with PyTorch, Facebook invented React and has been pervasively used by hundreds of millions of developers and billions on the web.
If neither of those are examples of Facebook's innovations on both the web and AI, then I don't know what is.
any company with tons of money is going to build some stuff thats innovative by virtue of hiring people completely irrelevant to its core product. FB is a social networking and ads company and it was not particularly innovative at that. It was not a web development house or an AI powerhouse, and it's still not (that's not where it makes its billions).
So by your own goalposts, they DID release innovations then?
> FB is a social networking and ads company and it was not particularly innovative at that.
I wonder what those psychologists and engineers who worked on the Like button with the team who built the AI that is used from that, to Ads and the social graph would say about the billions of dollars and stock value that it has made for Facebook.
Again, you set those exceeding low goalposts for your point. If not even that is an example of an innovation relevant to Facebook's business and made it billions of dollars, then perhaps nothing is.
The fact that you’re continuing to double down is astounding.
Or people calling Oculus and FBAI etc as facebook innovations. They are acquisitions of existing technologies, paying the way to innovator status
But, referring back to all my previous posts, you set them at “when did Facebook innovate”.
Maybe next time you comment, you actually read what is being criticized and stick to that, rather than this strawman you keep putting up.
IBM famously did this with the IBM PC. They didn’t end up holding the lead in computing, but they certainly stayed relevant for another decade while their mainframe and minicomputer competitors struggled to get into personal computing but were late to the party.
In the pop-business book “Bottom-Up Marketing,” this is given as one of the key strategies to being the leader: Play Defence.
I wouldn’t say that a company playing defence by throwing cash at every fad that comes along necessarily means they are dying or dead. It just means they know they have to have a finger in every pie, “just in case.” It’s insurance.
https://m.facebook.com/nt/screen/?params=%7B%22note_id%22%3A...
"We will start by interrupting all of the initiatives currently in motion to introduce new layers of management and bureaucracy"
Maybe it will pay off.
Senior Management going to Senior Manage
Let me fill my friends list with new AI friends who are like my actual friends, but cooler, kinder, and more helpful.
This will probably be the most likely use of AI. And where the money will go.
You'll no longer need an army of cheap labours in the third world to manipulate the online commons. Just a couple to get around capchas.
I have family members who will do that anyway. Fox news even floated some interesting theories post-election.
and
You support [political candidate]? They raised you to be better than that!
Then we can put it textbooks for study on creating tools that can be way too easily weaponized in a sprawling environment like the Web in current form. My money is on Poe's Law before Godwin, but by narrow odds. What, y'all thought this would end well? Go re-watch T2 damn.
https://slatestarcodex.com/2018/10/30/sort-by-controversial/
Do I think “generative AI” is huge - yes. But I also feel like people are starting to slap generative AI label on things somewhat motivated by silly reasons - marketing and pleasing investors who want to “keep up”. Or employees that want to work on something cool.
They only bought into the media fear and nonsense that Meta was going to $0.
The legs discussion is way overblown and happened only because the "Metaverse by Facebook" has nothing interesting going for it.
If it did offer a product people wanted, floating avatars would be nothing more than a running joke that nobody would really care about.
But as it turns out the desire of the FB C-suite to own a software platform is not a particularly good selling point and here we are.
On purpose??
$4bn and it doesn't have any legs.
Why play hogwarts legacy when you could go to meta hogwarts and actually talk to harry potter about your day? People think parasocial relationships are toxic to society now?!?
HAH.
Just wait till we start seeing headlines about people killing themselves over their favorite character (or worse ai wife/husband) getting digital dementia due to dataloss or being taken offline forever. It rings back to that movie HER the one where loads of people fell in love with the same AI model, except in that movie the model had agency and wasnt insidiously designed by a major social media/ads company to drive traffic and profits.
I know my comments might come off as inflammatory, but I want to make a very clear point that I hardly have seen mentioned elsewhere. The problems that we see with the terminally online and other forms of unhealthy attachment to online personas will only be amplified as VR and AI get better.
I guess that makes sense. It works great with their metaverse vision (and might give it the USP it desperately needs), while bringing short-term benefits as well. I wonder what they mean by text in WhatsApp though? A chatbot for companies to paritally automate all the business that now happens over WhatsApp, or a text-mode Alexa, kind of like XiaoBing (which far predates the current GPT craze, but is now much cheaper to create)?
You see similar activity on LinkedIn.
I will stay far away from whatever Zuck accomplishes with generative AI.
https://www.ftc.gov/news-events/news/press-releases/2019/07/...
It's easy to imagine a future in which Facebook have a paid monthly subscription to a friend, partner, therapist etc.
> with video and multi-modal experiences
And of course they'll try to slap some VR on top of it.
To exaggerate a little, I expect them to develop something like the Truman show where everything is sponsored and all "characters" try to sell you all the time.
that might be pretty cool actually. I tried a couple of shrink bots pre-chatgpt, they weren't very good back then, but I think with enough effort it might be possible to get them to a mid-level human shrink in this latest iteration. FB owns tons of conversational data to train on, too!
If you want to visit 2007-era Facebook, check out mbasic.facebook.com. It's the only way to access Facebook Messenger on mobile; the main mobile site redirects you to a download page for the Messenger app.
It'd be one thing if there was a single umbrella Facebook product, but Meta is going the opposite direction.
https://m.facebook.com/story.php?story_fbid=pfbid02zHwANqWrZ...
I denounce LeCun for his political tirades and just generally bad takes, but this statement of his is a healthy skepticism.
Let’s see if they actually do that or just build a gimmick
Its more of an annoyance to have a voice assistant at odds with you trying to push advertisement and listening in on your conversations to sell to you better. Factor in that voice doesn't always get it right it becomes a nuisance.
> Over the longer term, we'll focus on developing AI personas that can help people in a variety of ways.
So Facebook are getting into the SockPuppet persona business, has the US military [1,2] and other 5eyes+X countries put out a tender for new sockpuppets, because the existing one's are getting too easily detected?
Arent they causing enough trouble [3] psychologically manipulating people, causing Hurt, Embarrassment and Harm (HEH)?
Anyway those bots are still making money for some![4]
[1] https://www.theguardian.com/technology/2011/mar/17/us-spy-op...
[2] https://en.wikipedia.org/wiki/Operation_Earnest_Voice
[3] https://www.reddit.com/r/TikTokCringe/comments/vkv8hu/aww_th...
[4] https://markets.businessinsider.com/news/stocks/reddit-reviv...
is what what people write when they cannot think of a concrete example, or when they cannot get my boss to sign off on something...
[1] https://www.creativehuddle.co.uk/post/the-alternative-uses-t...