HNHacker News
TopNewBestAskShowJobs

authorfly

383 karma · joined February 27, 2024

submissionscomments
authorfly··on Looking for a Job Is Tough
The comments above you replied to were saying something different to your interpretation, I believe.

They were saying that by going remote (the last 5 years), people haven't formed as many deep connections by legitimate social connections at jobs and their reputation. You could say this is the "good" or "reputation" based way of getting jobs in the back door and it's not all just likeability. So there is less of this kind of back door hiring right. I don't know if this is true or not.

But the back door hiring for nepotism or "my brothers girlfriend" is still as ever present, since the connections aren't predicated on real life in person social interactions.

Discrimination or disadvantage comes in to neither of these hiring methods innately. Subconscious bias could exist for back door recommendations ofcourse.

So if anything, it's not really leveling anything. It just means for increasingly experienced engineers, benefits don't accrue so much when looking for work if remote. If anything these backdoor references could help people (e.g. from poor families) get a shot even despite other innate culture differences (e.g. style of speaking). And nepotistic hires will remain.

authorfly··on Ask HN: Is spaCy still relevant in the LLM era?
I don't think there are any more which is a shame, because spaCy was an amazing library and probably the library I most ever enjoyed working with, it truly felt like a craftsmans belt for intelligent text transformation/insight. Some things like topic clouds can still be useful for creative work but this is not where spaCy shines.

But ChatGPT can derive better insights, doesn't need pipelines, doesn't need hard coded approaches with their issues. And the (NLTK/Stanford parser-like) dependency views are still interesting for linguistic purposes.

authorfly··on Physical Intelligence's first generalist policy AI can finally do your laundry
It's not really a step change.

Saycan demonstrated similar functionality with PaLM 2 years ago (2.5 years first demo of cleaning up coke cans, etc):

https://www.youtube.com/watch?v=Ru23eWAQ6_E

Caveat - I am way out of my depth here as I focus on Software AI, but: I can't see any major breaks from SayCan looking at this information. When studying robotics, Degrees of Freedom/basic Arms and mechanisms (tension, grip, extension, types of joint etc) are a typical case study. However, I do not think there has been any practical progress (with the lack of data) in about 20 years now, besides increased refinement from materials science (e.g. detection of soft materials) allowing some better grip but not particularly better dynamic movement(e.g. walking remains badly solved compared to the efficiency/mechanism of humans).

authorfly··on Trump wins presidency for second time
Hhhm, no not really unless you are in the bottom 30% of earners in the US.

You can get US-like outcomes (or worse) on the NHS with the waiting list, or you can get good health care on time with private health insurance. However, you have to pay for the NHS (via National Insurance and higher income taxes) either way on top of private health insurance.

Quality of life and life expectancy/hospital outcomes like Cancer 5 years survival rate, stage of diagnosis are generally worse or equal in the UK to the healthcare the majority of Americans receive. The UK stats are on paper equal or only slightly better on a population basis, but strip out people in the UK with private healthcare or look at it regionally and you will see the sad truth that the NHS has pretty bad outcomes. As in our left wing politicians in power are calling it broken. It is very bad. Really really bad.

If you take out people on private healthcare, there is little difference in outcomes, and you'll be paying the same at the end of the day, just in the UK, without sufficient coverage, options to pay massive sums for the top treatments are often not available in the first place.

authorfly··on Trump wins presidency for second time
I would suggest you prepare to purchase private health care in the UK given the waiting lists.
authorfly··on Trump wins presidency for second time
What wealth tax concerns you?

Most of the tax begins at $80k+ and then $110k+ yearly income but not so much wealth from my understanding.

PS; The Dutch government may reverse the negative expat changes, especially regarding the special status for capital gains from outside the country in the coming years. And check out Germany. They may also shortly set up a scheme.

authorfly··on Any Indiehackers.com Alternatives
pioneer.app in their group-weekly update mode was the closest thing to early indie hackers. Sadly they shut down that mechanism, I don't know why.

It was great for weekly reality checks but also UI and headline help.

That said, I had a FOMO of the "YC-access" and so I chose to spend B2B money with other companies at the startup stage (I know, foolish move). I spent a lot of money on Banana.dev, and helped their cofounders with feedback around concurrency/load for the API. Right as we gained some traction, they doubled prices, then changed the pricing model to make it unaffordable for us to run on their services. Felt a little nasty. And recently their pricing hit "you can only afford this if you already have VC level money"(probably to thin customers to a profitable subset).

authorfly··on Tell HN: ChatGPT now "knows" your geolocation
Consider how much info cookies and user intent contain about each user via persistent session tracking.

I wonder if we will see ChatGPT include a behind the scenes giant JSON with 2-20k fields about the personal in the chat and have finetuned "personal situation" ChatGPTs (or just include it in the prompt).

We might find it abhorrent now, but like tracking, it might just come over time. First location, then interests, etc.

authorfly··on Sleep regularity is a stronger predictor of mortality than sleep duration (2023)
For a bit of alternate perspective, I had a happy life until a night shift worker moved in next to me, and began setting off alarms, cooking and leaving at variable times while experimenting with their sleep. They explained how they could sleep through everything. Completely oblivious to why the building wanted them to leave(I'm not saying this is the same for you).

Maybe that is what this study is capturing.

authorfly··on SimpleQA
True, but this pattern was established with TrufulQA a couple of years ago.

I disagreed then but it's unfortunately convenient to use this approach for some benchmarks.

authorfly··on Ask HN: Real-time speech-to-speech translation
Your library is quite possibly the best example of effortful, understandable and useful work I have ever seen - principally evidenced by how you keep evolving with the times. I've seen you keep it up to date and even on the edge now for years and through multiple NLP mini-revolutions (sentence embeddings/new uses) and what must have been the annoying release of LLMs and still push on to have an explainable and useful library.

Code from txtai just feels like exactly the right way to express what I am usually trying to do in NLP.

My highest commendations. If you ever have time, please share your experience/what lead to you taking this path with txtai. For example I see you started in earnest around August 2020 (maybe before) - at that time i would love to know if you imagined LLMs coming on to be as prominent as they are now and for instruction-tuning to work as well as it is. I know at that time many PhD students I knew in NLP (and profs) felt LLMs were far too unreliable and would not reach e.g. consistent scores on MMLU/HELLASWAG.

authorfly··on Probably pay attention to tokenizers
We don't disagree. A look up table with exact rules is a rules system to me from an NLP/GOFAI perspective. I was aware of how the libraries tend to work because I had often used things like looking up lemmas/word sense/pos in NLTK and Spacy in the past, and I know the libraries code fairly well.

Context today may mean more (e.g. the whole sentence, or string, or the prompt context for an LLM), and obviously context has a meaning in computational linguistics (e.g. "context free grammar"), but the point here is stemmers arbitrary follow the same process without a second stage. If a stemmer encounters "best" and "good" it by definition does not have a stage to use the same lemma for them. Context is just one of those overloaded terms unfortunately.

Lemmatizing, in terms of how it works on simple scenarios (lets imagine reviews) helps to lump those words together and correctly identify the proportion of term frequencies for words we might be interested in more consistently than stemming can. It's still limited by using word breaks like spaces or punctuation ofcourse.

authorfly··on Probably pay attention to tokenizers
Yes, but you can control that.

You can use set fit, less examples, or SVM or etc depending on how much separation, recall and other aspects matter to you for the task at hand.

Sensitivity level to biasing to the dataset is a choice of training method, not an attribute.

It's just not really a major issue unless you finetune with an entirely new or unseen language in the present day.

authorfly··on Probably pay attention to tokenizers
Check out the training data. Sentence transformer models training data includes lots of typos and this is desirable. There was debate around training/inferencing with stemmed/postprocessing words for a long time.

Typos should minimally impact your RAG.

authorfly··on Probably pay attention to tokenizers
Stemming is basically rules based on the characters. It came first.

This is because most words in most languages follow patterns of affixes/prefixes (e.g. worse/worst, harder/hardest), but not always (good/better/best)

The problem was that word/term frequency based modelling would inappropriately not linked terms that actually had the same route (stam or stem).

Stemming removed those affixes so it turned "worse and worst" into "wor and wor" and "harder/hardest" into "hard", etc.

However it failed for cases like good/better.

Lemmatizing was a larger context and built up databases of word senses linking such cases to more reliably process words. So lemmatizing is rules based, plus more.

authorfly··on Probably pay attention to tokenizers
Yes those models were sensitive to the preprocessing, far more than transformers.

However Word2Vec and GloVe were fundamentally different, when used as designed GloVe worked better pretty uniformly.

authorfly··on Energy-based model explains how chronic stress transforms into disease over time
Ok, I understand some of this. I know that often the structure of proteins (especially e.g. with ATP Synthase) helps drive and time limits energy production or energy signalling. Just like how the plugging/unplugging of sodium channels naturally creates equal windows for sodium to enter Neurons during action potentials, the natural duration of ATP synthase and other processes establishes a sort of time unit, wherever the ATP is.

Please can you expand a little more. I am a novice so I'm sure there must be something here I have missed, and would love to know what that is:

What I am a little confused about is that the consumption of energy is not done at the same time as consumption, unless I am wrong?

For example when muscles are used or repair during hysteresis, the mitochondria produced the ATP used in that reaction long before the event.

I suppose you can argue any energy consumption via chronic stress effects that. However, because it is local, distributed and there are a few forms of stored energy in essence and uses of it (e.g. mitosis/DNA nucleotide production), it's not like having one singular energy total that goes down, is it?

It's feasible that each area of the body can upscale production and produce their different kinds of energy/energy store more efficiently over time, since most of the time the body is not producing ATP at peak rate. Is the argument that doing that would wear out parts of the cells we have faster or something, due to the chronic stress, compared to what they typically see?

I struggle to buy this argument because we know that heavily overweight people consume much more calories (and thus more ATP Synthase etc) for their number of cells but they don't necessarily die much younger until you reach severe levels of being obese.

authorfly··on Please do not write below the line
The point is they have as much to gain from encouraging people to believe they actively use "TV scanners" and you can't know when they are about with their vans as saying nothing.

Cynically it gets your auntie talking, brings TV license to front of mind.

It's doubtful they ever actually did such a thing.

authorfly··on BMI-type measure for a place's "goodness of weather"
Give me a breakdown of how many 9am 30 minute commutes I'll get reasonably rained on (20%+ precipitation) divided by normalized sun flower hours during the non-winter 3 seasons, please.
authorfly··on Ask HN: Does GenZ still read blogs?
There was a trend in 2000-2010 to publish blog backlogs as books. For me growing up before widespread availability of a home or school computer I could usually access, yet when hacker culture was proliferating in the US, these were a godsend.
authorfly··on Please do not write below the line
"Please do not park next to our nondescript White Van" would suite just as much.
authorfly··on Energy-based model explains how chronic stress transforms into disease over time
I absolutely don't doubt you but can you provide some accessible education resources or some sports science/biochemistry papers for the claim around "That limited capacity to consume energy applies to exercise, brain activity, thermogenesis, digestion, and every other biological process as well. It is a fundamental aspect of cellular biology and a major focus in the field of exercise physiology." ?

What energy are we talking about here exactly? ATP?

authorfly··on Microsoft and OpenAI's close partnership shows signs of fraying
This reasoning about the subscription price etc is undermined by the actual prices OpenAI are charging -

The price of a model capable of 4o mini level performance used to be 100x higher.

Yes, literally 100x. The original "davinci model" (and I paid $5 figures for using it throughout 2021-2022) cost $0.06/1k tokens.

So it's not inverting in running costs (which are the thing that will kill a company). Struggling with training costs (which is where you correctly identify OpenAI is spending) will stop growth perhaps, but won't kill you if you have to pull the plug.

I suspect subscription prices are based on market capture and perceived customer value, plus plans for training, not running costs.

authorfly··on The Fifth Generation Project in Japan (1992)
Japan has stagnated and had debt problems over those 40 years. May I ask you if you saw these as they began to accrue and if you think there is a long term strategy to address them?

Seems to me as an alien to the culture, that Japan is uniquely happy to continue on conservatively (culturally) without giving in to medium term fixes(e.g. immigration) but with no long term plan for the economics or population. Is this because of a different cultural view on those things and whether they are successes, or failures?

authorfly··on NotebookLM launches feature to customize and guide audio overviews
The 100 baseline on that graph is the highest attention the term has received, and it correlated with a launch and has since decreased.

Google never has problems with first the first few millions for consumer-launched tools. They have problems with the first few millions of net profit almost 100% of the time and shut it down a few years later.

But I do agree this is a good play for Google, it plays to their strengths.

authorfly··on Ask HN: Solopreneurs, how did you come up with your idea?
Oh nevermind, I must have misread your comment (or you updated it) to represent the opposite. I think looking for under-seen/under-resolved niches is useful.
authorfly··on Ask HN: Solopreneurs, how did you come up with your idea?
Exactly.

The unspoken thing about startups/the mom test is that now the majority of startups try to do it that way.

Well, 90% of startups still fail.

So why do the thing that 90% of the time doesn't work?

Really successful startups tend to be strongly unique and lead by a few years of personal experience with the problem. Perseverance and defiance(to the way things are/problem remaining) can't be bought though and it won't sell a book.

authorfly··on Ask HN: Solopreneurs, how did you come up with your idea?
Agree, agree, agree.

This is how you make great margins, work with people who want you to work with them, and you have no fear of the competition increasing CPC etc. Can also be more rewarding.

Once you have a decade in startups, you realize this is incredibly important. Not only that, when you do seek funding, being unique is a plus: You'll be dismissed outright or you'll be accepted. That's way more useful that being "in the ball pit" for "possible investment in our coming financial years".

authorfly··on $2 H100s: How the GPU Rental Bubble Burst
Well, it's in academia, in traditional universities, any way. I think corporates are still thriving. I can say from an academic point of view, I knew 4 PhDs who started in 2018/2019, all 4 got depressed and left the field.

Their research was obsolete before they were halfway through.

Usually some PhD students get depressed, but these 4 had awful timing. Their professors were stuck on 3-10 year grants doing things like BERT finetuning or convolution or basic level AI work - stuff that as soon as GPT-3 came out, was clearly obsolete, but nobody could admit that and lose the grants.. In other cases, their work had value, but drew less attention than it should have became all attention went to GPT-3 or people assumed it was just some wrapper technology.

The nature of academia and the incentive system caused this; academia is a cruise ship which is hard to turn. If the lighthouse light of attention moves off your ship on to another fancy ship, your only best is lifeboats(industry) or hoping the light and your ship intersect again.

The professors have largely decided to steer either right into Generative AI and using the larger models (which they could never feasibly train themselves) for research, or gone even deeper into basic AI.

The problem? The research grants are all about LLMs, not basic AI.

So basically a slew of researchers willing and able to take on basic AI research are leaving the field now. As many are entering as usual ofcourse, but largely on the LLM bandwagon.

That may be fine. The history of AI winters suggests putting all the chips on the same game like this is folly.

I recall journals in the 90s and 2000s (my time in universities was after they were released, but I read them), the distribution of AI was broad. Some GOFAI, some neural nets, many papers about filters or clear visual scene detection etc. Today it's largely LLM or LM papers. There is not much of a "counterweight underdog" like neural networks served the role off in the 90s/00s.

At the same time, for people working in the fields you mention, double check the proportion of research money going into companies vs institutions. While it is true things like TortoiseTTS[1] were an individual effort, that kind of thing is now a massive exception. In stead companies like OpenAI/Google literally have 1000+ researchers each developing the cutting edge in about 5 fields. Universities have barely any chance.

This is how the DARPA AI winter went to my understanding(and I listened to one of the few people who "survived via hibernation" during my undergraduate); over promising - central focus on one technology - then company development of projects - government involvement - disappointment - cancellation.

[1] https://github.com/neonbjb/tortoise-tts

authorfly··on Proposal: JavaScript Structs
"Everybody who does Express, React, or any other popular advanced libraries with TypeScript is using these features. Some things are simply more useful to libraries than line of business code - that's fine. The line of business code is much better thanks to it."

I think your model of how people use modules is flawed.

I doubt most people using those modules are using typescript to mostly interact with them, because of the perceived subjective benefit you see of typing everything.

For example, I use many typescript-written modules without using typescript in the code that uses them, and am better off for it. Because I and my R&D work does not want the advanced features of typescript. We can switch to it, or a OOP server language if that is useful later.

Exposing types to me usefully in libraries to use "with Typescript" as you claim means my own code has to be typescript. In that case, to avoid compile errors and a wall of "any" types, I reasonably have to switch my own code to use Typescript classes etc, even where this is just bloat etc. Another reason I have libraries is to do things without ever interacting with them other than input props (e.g. a drag'n'drop library with JSX components). In that case, the type (JSX Component) is irrelevant to me to include, and for experienced developers, approximately 0% are going to give something other than a JSX component as an input to a drag'n'drop library, etc.

In other words - I derive benefit from them using Typescript without having to use it myself. Pushing Typescript as "necessary" because popular libraries have interfaces is exactly the kind of thing that slows down R&D and fast processes.

I have used many languages with types for many years. I understand their value. However, much of the value is code coherence, working with other people, and domain models being embedded in the code. These benefits are not always useful in small web applications.

Typing is one of those things... you love it to make your life learning code easier and for big projects, and for certainty when you are coding boring things. For other things in life, there's more to life than writing type definitions and overloading methods. You can be much more productive just using primitives in some scenarios and make research discoveries faster and with more flexibility.

What I have seen is every generation of coders, a new type-heavy language/framework becomes popular (.NET, Java, Typescript), then it becomes "uncool" because people realize how bulky and useless most of it is - especially for anything small/research-y, then it loses adoption and is replaced by another.

← PreviousPage 3 of 9Next →