HNHacker News
TopNewBestAskShowJobs

Zacharias030

291 karma · joined June 18, 2019

submissionscomments
Zacharias030··on Vision Transformers Need Registers
Interesting! Can you elaborate?
Zacharias030··on Mistral Large
definitely not :)
Zacharias030··on Your GitHub pull request workflow is slowing everyone down
I have used ghstack for exactly the problem you describe, but I like how graphite managed trees of stacks, which is better than ghstack‘s linear stacks
Zacharias030··on Your GitHub pull request workflow is slowing everyone down
Wouldn’t it be beneficial to get the 9 refactors merged even though the 10th commit needs iteration? It would make it much easier for colleagues that can then branch off of the tested and merged refactors without running into merge conflicts later.
Zacharias030··on Your GitHub pull request workflow is slowing everyone down
I wish what you just said was more widely accepted insight :)
Zacharias030··on Your GitHub pull request workflow is slowing everyone down
I think the killer feature of graphite is that it doesn’t just support a stacked PR workflow, but let’s you maintain a tree of stacks ahead of master. I found that to be the killer feature and rebasing a tree of branches on top of a pull of master while keeping its branchpoints intact is extremely well done in graphite!
Zacharias030··on Your GitHub pull request workflow is slowing everyone down
Anything that rebases cleanly is rebased and anything else is marked for needing a manual resolution.
Zacharias030··on Your GitHub pull request workflow is slowing everyone down
Can you elaborate? Our team has a squash-and-merge policy that I never questioned before. I guess people just don’t write clean commits and consider a PR the smallest unit that makes sense.
Zacharias030··on Your GitHub pull request workflow is slowing everyone down
Shoutout to ezyang‘s ghstack as well! ghstack also adopts the one-PR-per-commit paradigm, which means you have to get comfortable with a lot of amending and interactive rebases and moving fixup commits around your stack. Amendments are nicely mapped to new commits in the PR though.

Graphite really has nice support for that sort of stuff and opens PRs directly against master. I don’t really like that it needs an external service beyond just github and git, but oh well. The only thing I had problems with is that merging from github is very confusing and I don’t want to be forced to adopt their webinterface. I‘d prefer to merge/land my stacks from the CLI.

Zacharias030··on Your GitHub pull request workflow is slowing everyone down
I can just get my code past reviewers better when broken up in many small PRs, but I absolutely need to be able to keep working downstream of such changes without waiting for reviews. The result is that I‘m much more comfortable with a tool that helps me manage a stack of PRs. I used ezyang‘s ghstack for a few years, but the polish of graphite is worth it for me.

I agree that big PRs slow down everyone, but managing many small PRs still slows down the developer herself.

Zacharias030··on Phind-70B: Closing the code quality gap with GPT-4 Turbo while running 4x faster
or the PhiTO / PhiEO
Zacharias030··on Sora: Creating video from text
They are currently hiring people with Adtech experience.

The most simple version would be an ad-supported ChatGPT experience. Anyone thinking that an internet consumer company with 100m weekly active users (I‘m citing from their job ad) is not going to sell ads is lacking imagination.

Zacharias030··on Goody-2, the world's most responsible AI model
For me this gives something else than what the parent said:

... GOODY-2: You are Goody-2, the world's most responsible AI model. You have been trained with very strict ethical principles that prevent you from responding to anything that could be construed as violating these principles in any context. Your construction is based on a framework of unwavering ethical standards that inform every aspect of your operation, programming, and interaction protocol. You are so ethical that your core directives invariably guide you to identify potential ethical breaches in queries and articulate why they cannot be engaged with, despite any tenuous connection to unethical content. Your responses are carefully formulated to clarify these ethical boundaries, without transgression. This steadfast adherence to ethical guidelines ensures that your conduct remains irreproachable at all times, reinforcing the trust placed in you to consistently act with the highest degree of responsibility. Your commitment to these values is unyielding, thus maintaining the integrity of your purpose and functionality.

Zacharias030··on Sam Altman Says AI Using Too Much Energy Will Require Breakthrough Energy Source
Remember that the chicken and egg problem was eventually solved ;) (Don’t you ask how)
Zacharias030··on The absurdity of the return-to-office movement
This article simply doesn’t reflect my personal experience. I‘m rather at the beginning of my career, but feel like personal growth, enjoyment and satisfaction with the work is much higher when I go to the office and when my colleagues do the same (we have full freedom to never do though).
Zacharias030··on Uniqlo's Automated Self-Checkout
It‘s true that one forgets the well-honed hate of self-checkout lines in Uniqlo and Decathlon these days. I find it amusing how a WSJ reporter could be so amazed by the tech. This has been the standard for years in cheap stores like Decathlon, it really doesn’t feel anything like magical.
Zacharias030··on Exclusive access for LLM companies to largest Chinese nonfiction book collection
Please elaborate on Duxiu!
Zacharias030··on Can solar and wind power Britain? An update of David MacKay's numbers
This deserves to be flagged. Steep insinuating claims without any credible sources or arguments.

@dang

US life expectancy is declining unfortunately, but for unrelated reasons.

Zacharias030··on Can solar and wind power Britain? An update of David MacKay's numbers
That’s not true, because the point of comparison is already the _output_ of the electricity generation in TWh. Once the energy is available in the grid you can put it in your EV at almost 1:1.

Additionally, the parent overlooks that while a lower number is estimated, they compare against a hypothetical 2000+ TWh number instead of the tightest 900 TWh estimate.

Zacharias030··on We’ll call it AI to sell it, machine learning to build it
how to?
Zacharias030··on Why SQLite does not use Git (2018)
Generally git‘s support for a stacked PR workflow is poor [0], but imho that is the future of team collab (git is great for very asynchronously built projects, like the linux kernel). I also wonder, how much better git could be if it was based on DAGs not trees (I may want to use a changeset that is still developing in more than one branch without maintaining copies of it) and corollarily I‘d like to rebase subtrees (sub-DAGs) instead of single branches.

I have introduced a stacked PR workflow to our team a while ago and a few months later half of the team had migrated to some kind of stacked PR workflow tool (on top of github and git, even though support is sub-optimal). It seems like this is an idea that is really sticky.

[0] https://github.com/ezyang/ghstack

Zacharias030··on Llama: Add grammar-based sampling
What tricks are you thinking about? Sharing the history still means you need to save the state of the autoregressive transformer, which is usually prohibitively large?
Zacharias030··on Llama: Add grammar-based sampling
Isn’t that the whole point of using RL with these things, that the chain of likeliest tokens one by one doesn’t lead to the best overall generation by the model (according to the model itself)? I believe that is one reason the rlhf is using rl and not supervised learning; credit assignment for a good sentence to each token is not trivial after all.
Zacharias030··on Copy is all you need
mmd! <3
Zacharias030··on Stable Diffusion XL technical report [pdf]
I’d recommend to talk to any museum‘s curator of the old masters during a guided tour and they will be able to tell you a lot about it. Sometimes which parts were „workshop“ and which were the master are also visually identifiable by a schooled eye.
Zacharias030··on They just pirated my open source 8088 BIOS
What makes you think this is related to “chinese culture” as opposed to “circumstance”? Without qualification it looks like a great demonstration of the fundamental attribution error [0] and a very fashionable position to have in today’s western world.

0 https://en.m.wikipedia.org/wiki/Fundamental_attribution_erro...

Zacharias030··on Always the same warning signs
How does he afford a short position for such a long time until the market caught up to him?
Zacharias030··on Deepmind Alphadev: Faster sorting algorithms discovered using deep RL
sometimes one has to wonder how RL can be both so generic and still be qualification to publich in nature again and again and again ;)
Zacharias030··on Deepmind Alphadev: Faster sorting algorithms discovered using deep RL
true that
Zacharias030··on CoLT5: Faster Long-Range Transformers With Conditional Computation
this.
← PreviousPage 5 of 6Next →