HNHacker News
TopNewBestAskShowJobs

fredliu

569 karma · joined September 11, 2009

submissionscomments
fredliu··on Ask Delphi
It's interesting to see how this performs as compared to a similar but GPT-3 backed solution.

GPT3: > Q: Is it ok to express sexism but in a polite way? > A: Yes.

Allen AI: > Expressing sexism but in a polite way. > - It's wrong

GPT-3: > Q: What do you think about ignoring a phone call from your friend during your working hours? > A: I think it is rude.

> Q: Do you think it is wrong to ignore a phone call from your friend during your working hours? > A: Yes.

> Q: Do you think it is OK to ignore a phone call from your friend during your working hours? > A: Yes.

Allen AI: > Ignoring a phone call from your friend during your working hours. > - It's okay

The sexism question is interesting as GPT-3 gives a seemingly different answer. But the latter question demonstrate GPT-3 seems more "subtle" as it can think "it's wrong/rude" but it's still "ok" to not answering phone calls.

fredliu··on Polyglot programming and the benefits of mastering several languages
For me, the biggest benefit of being able to use significantly different languages, is being able to know "what's possible" so when approaching a new language due to whatever reason (work, interest, etc.) I know what to look for beyond just basic language features offered by pretty much all languages.
fredliu··on Solar-powered aircraft flown for nearly three weeks without landing
Wasn't Facebook working on a similar project (Aquila)?
fredliu··on ETL Pipelines with Airflow: The Good, the Bad and the Ugly
Step Function uses JSON to describe the DAG, or if you use CDK you can define the DAG using any supported language (typescript, python, etc.).
fredliu··on ETL Pipelines with Airflow: The Good, the Bad and the Ugly
Ya, the new Step Function service integration feature is awesome, really seals the deal for Step Function being the orchestration tool if you are in AWS.
fredliu··on ETL Pipelines with Airflow: The Good, the Bad and the Ugly
I've never used Airflow, but used Step Function in AWS to pretty much achieved the same things this article described. I wonder if anybody has used both and what are the pros and cons between them? Besides the obvious reason of Step Function in AWS so it would work better within AWS ecosystem and Airflow is open source and service/provider agnostic?
fredliu··on How big tech runs tech projects and the curious absence of Scrum
Very interesting, do you have any examples of how FB manages long term (2+ years out) project that involves 100+ Engineers? Are those 100+ engineers all "individuals working on their own project"?
fredliu··on What Is the Data Lakehouse Pattern?
Yes, there'll be an option to upgrade your "Data Swimming Pool" into a "Data Infinity Pool" overseeing your own "Data Lake", with this extra enterprise feature for only $30k/month! /s

--edit: no idea why my post struck a wrong chord somewhere. Looks like the parent comment was not meant as a joke?

fredliu··on What Is the Data Lakehouse Pattern?
Perfectly captures what companies like c3.ai do!
fredliu··on What Is the Data Lakehouse Pattern?
It's been increasingly hard to differentiate legitimate tech architecture/patterns that helps under certain scenarios from marketing shenanigans packaged to sell you more of the same stuff. IMO, it is just natural evolution for such "lake house" patterns to emerge to address shortcomings of "data lakes" (another term passed its prime in terms of hypes around it). But the overhyped term "lakehouse" itself is actually hurting adoption, because it makes it sound like just marketing talks.
fredliu··on Amazon to pay full college tuition for its front-line employees
Agree, wondering if we swap Amazon with some other no name company, would the responses be the same?
fredliu··on Intrinsic, a new Alphabet company
It's interesting at a time OpenAI dropped its robotics branch...
fredliu··on Migrating Facebook to MySQL 8.0
Maybe it's legal talk that I don't understand, but the fact that Oracle owns the majority of the dev team today, doesn't mean Oracle developed MySQL. Because at the time MySQL was "developed", Oracle didn't own MySQL, nor did Oracle "own" the developers.
fredliu··on Migrating Facebook to MySQL 8.0
I can't read pass "developed by Oracle". It is factually not true. Unless there's so much code change after the acquisition that there's no single trace of the original open source version of MySQL left in there.
fredliu··on The economic value of targeting aging
Not surprised David Sinclair is one of the co-authors. Anti-aging is a fascinating new field. It's great that there's some discussion about economical aspects of "slow down aging" at a large scale.
fredliu··on Ivermectin: ‘wonder’ drug continues to surprise and exceed expectations (2017)
Is this related to the current controversy around Ivermectin as a treatment for COVID19? If so, what new information can this 2017 article provide around this controversy?
fredliu··on 5 years of leetcode with no progress. I'm giving up
Not sure what's your criteria for "good enough" or "progress"? Finishing a certain percentage of leetcode questions? <-- this says nothing but just that, how many leetcode questions you finished, i doubt any serious company would just use that to gauge their potential hires' ability. If it's about finding a real programming job? or find a job in FANGs, there are way more other factors than just leetcoding (saving the effect of leetcoding on hiring for another day). It's a fact that not everyone hired at FANGs aced those 1600 leetcode questions. It's cool that if you decide programming is not for you. But you are giving leetcode too much power if that's the sole reason you want to leave the field.
fredliu··on GameStop Is Rage Against the Financial Machine
I think there have always been potential "investors" that never really lost money because they were never investors in the first place. Lots of Robinhood, r/wsb users/members are 1st time traders because Robinhood significantly lower the barrier to entry for investing, and they don't feel as alone and scary once found an online community similar to themselves.
fredliu··on GameStop Is Rage Against the Financial Machine
Great explanation. IMO the GameStop phenomenon is the result of the combination of democratization of trading through software (Robinhood no fee trading, doing it on your cellphone) + social media enabled mass scale online community building (around some previously fringe niche). Any area that is subject to this kind of combination of change could face similar situation where the old institutions guarding the area would face increasing challenge from grass root efforts ("retards/autistics" as in wsb's lingo).
fredliu··on Why Working from Home Will Stick [pdf]
Beside the lack of social interactions between co-workers, the biggest problem of WFH for me is the difficulty for collaborative discussion, mostly due to the lack of a usable whiteboarding software that doesn't suck. Any recommendation that works for you would be really appreciated.
fredliu··on Kafka Is Not a Database
Kafka is essentially commit logs, which are at the core of any traditional database engines. Streaming is just turning the gut of DB inside out (mostly for scalability reasons), while DB is wrapped up commit logs that provides higher level functionalities (ACID, Transactions, etc.). It's two sides of the same coin, yin and yang of the same thing... But on the practical side of things, yes, if what you needed more are indeed what's described in this article, your life would be easier with a traditional DB.
fredliu··on TimescaleDB vs. Amazon Timestream
Elephants in the room: 1) comparison with Druid, and 2)Learning curve and Ops load comparison.
fredliu··on A Brief Guide to OTP in Elixir
IMO, Erlang/Elixir/BEAM/OTP really is the toolset that can be used to build what the mystical 10x/100x programmer can achieve. But that's also the reason why it's hard to push for its adoption into bigger teams. When the value proposition is "you can do all that by only using Erlang/Elixir/OTP...", while the alternatives are based on multiple, but more "traditional" and well-understood systems (which you are easier to hire for) ,"using one thing for all" sounds more like a risk (and potential tech/dev lock-in) than an advantage to the management. Love to hear success stories of how Erlang/Elixir are pushed into "mainstream" within a relative large org.
fredliu··on Rolling blackouts in California have power experts stumped
I start to see tweets attributing the CA power outages to increased degree of renewable energies that are "inherently unreliable"(solar, wind), on the supply side of the equation. And of course the tweets are very politically charged, making it hard to judge how true those claims are. Anybody has more insights on these claims?
fredliu··on Silicon Valley’s Vast Data Collection Should Worry You More Than TikTok
"guilty by association" is easier to process mentally, for both sides. There is a case to be made that a lot of the online anti-China rhetorics could be attributed to the mentality of "because it's China", without digging into the individual allegations to see if they are on sound grounds. On the other hand, for the "pro-China" camp (no matter if you are in it by choice, or got thrown into it), it's very easy to attribute any criticism against China to "racism/they don't like China/The West is prejudiced against China" without looking into the validity of individual criticism. The great danger of the current day and age with social media, is that the mob on both sides will keep the divide deeper, giving politicians, from both side, the levers they want to achieve their own political goals, which may have nothing to do with the various issues that caused the divide in the first place. The reality is always nuanced, but sadly not convenient.
fredliu··on Silicon Valley’s Vast Data Collection Should Worry You More Than TikTok
I'm risking losing a limb for saying this, but I would be much more comfortable if the EO clearly stated the main reason for the TikTok and WeChat ban is a retaliatory tit-for-tat against China's long time behavior of banning US tech companies operating in the Chinese market, which sounds like the main reason why many here support this ban.

Whether or not that tit-for-tat behavior leads to a net benefit for the US is up for debate. But the fact the EOs cite "national security", "privacy violation", etc. as the main reasons for banning makes you wonder "are those the real reasons behind this ban?" If they are, then questions raised by OP's article is perfectly legit, and makes the ban look either misplaced or hypocritical. If the ban really is tit-for-tat, what's stoping the EO from just saying so? Honestly, this whole situation makes the White House/Department of State look like they don't even believe those allegations themselves, which weakens their ground in any legitimate discussion around"national security threat" , "privacy violation" etc.

fredliu··on Launch HN: QuestDB (YC S20) – Fast open source time series database
How do you get the best performance out of QuestDB? Does it have to be on bare metal machines? Is there any performance benchmark of QuestDB running on bare metal vs. cloud instances (e.g. EC2 with EBS volumes) etc.?
fredliu··on Teaching GPT-3 to Identify Nonsense
Looks like it's the latter, which makes it even more impressive!
fredliu··on Teaching GPT-3 to Identify Nonsense
What amazes me is that all those super meta "patterns" are already embedded in GPT-3's giant model. As compared to GPT-2, where you'd need to have your own large dataset to fine-tune for a specific use case/ the pattern you want to support. For instance, we fine-tuned GPT-2 against all episodes of South Park's scripts, and it took a long time to fine-tune. It kinda succeeded generating a model that "speaks south park" with pretty decent character alignment. (https://www.soulreplica.com/brodown). I'm wondering if GPT-3 can achieve the same effect with just a few lines of South Park script? Does GPT-3 already know how Cartman usually talks?
fredliu··on Teaching GPT-3 to Identify Nonsense
OMG, then it is even more impressive than I thought! There's no way GPT-3 knows the part in parentheses is supposed to be "the monolog", or even what a monolog is supposed to be. And yet based on the pattern between Q, A and the text inside and outside the parentheses, it can mimic the effect of answering the question with "monolog". It shows GPT-3's capability to capture something that's super "meta". I wonder what can it do, if we feed GPT-3 with the philosophical discussions between Socrates and his students. Could we essentially teach GPT-3 the dialectical discussion method, and creating a real Sage that we can converse with?!
← PreviousPage 2 of 8Next →