297 karma · joined August 9, 2022
[[username]][[hardy number]] at g mail
My guess is that it's the entry-point to OCR and the internet is flooded by that, just like pandas for data processing.
actv = A[_:1] & B[_:1]
sign = A[_:0] ^ B[_:0]
dot = pop_count(actv & !sign) - pop_count(actv & sign)
It can probably be made more efficient by taking a column-first format.
Since we are in CPU land, we mostly deal with dot products that match the cache size, I don't assume we have a tiled matmul instruction which is unlikely to support this weird 1-bit format.
typically for 1-bit matmul, you can get away with xors and pop_counts which should have a better throughput profile than FMA when taking into account the SIMD nature of the inputs/outputs.
Liquid money rich? No.
Can get pulled for big tech packages? Also no, for most of the employees.
AFAIK, big tech didn’t aggressively poach OpenAI-like talent, they did spend 10M+ pay packages but it was for a select few research scientists. Some folks left and came but it boiled down to culture mostly.
What's key is be able to visualize metrics easily on the data and frictionless data entry, I've got a decent setup with iPhone Action + Obsidian + QuickAdd scripts on Obsidian Sync (mobile + laptop). for visualization I use Obsidian Bases and Obsidian notes that run Dataview code blocks and Chart.js, couldn't be happier.
I could track things that are not interesting to reflect on like vitamin D supplementation for accountability but I've never bothered, especially if it's taken ~daily.
Could even enable some stuff like passing loggers around not by parameters but by effect.
- pro motion (120hz screen).
- better display brightness which is important when there is a bright sun outside.
- 1 more USB-C port and HDMI port (no dongle hell).
- 20% more battery life.
- This is more personal, but 13" is too small and 15" is too big, so 14" MBP worked best for me (~25 HFOV with a stand + KBM).
It's hard to justify saving 400 bucks given the gap between the models, but the decision is closer since the air has 16GB memory by default since M4 AFAIK.
It was difficult to detrain and that made me stop using voice chat with LLMs all together.
I hope they can minimize the bookkeeping costs because I don't see it gain traction in AI if it hurts big kernels performance.
I tend to agree but I have a feeling that it takes a certain number of bad apples min-maxing KPIs to destroy the system.
When the manager evaluates you based on how many lines of code you submitted because the VP decided that the teams with the most code submitted deserve a bigger bonus, then you stop doing the rational thing and start playing the game, it may be possible for the middle manager to play around a bad VP but from an IC level it's rarely worth it, you might invest your small political capital only to be burned afterwards.
I've seen way too often in my career benevolent IC ignoring the politics, getting things done only to be last to be recognized when it's clear things would be falling apart without them. Even worse, doing the right thing might keep/hide the dysfunctional system for longer.
Sorry for being overly negative, I like the theory but failure points while rare are common enough for me to have seen them a few times, if things are not rotten it probably holds water.
Yes, leadership could do the right thing, but the right thing is difficult to measure by shareholders and can only grasped by shareholders until it is too late (Disney for example), but why would they?
I agree, people are not malicious but the system currently selects for people that ignore the difficult to measure right thing to do (in SWE it’s doing the grunt platform work that no one will appreciate) and skip to things that are rewarded (cool feature tm that users hate by gives a cool slide to the CEO), it might seem like people can do both but it’s not in practice due to having limited energy.
Also stream of thought answer, but I feel like we are back to the trust thing, the right thing to do is impossible to measure, so we can only hope they do it because they care about doing the right thing, but incentives punishes them and makes them scarce at the top and the only solution is to go back to a high trust society (maybe like Japan where CEOs care and the incentives are set so people are often doing the right thing).
The meta recently has been to ignore everything and only focus on maximizing the stock price, which is aligned with their incentives (stock based compensation, bonus based on stock performance) and the modern investors (money quick now).
I wonder if the rotten feeling I have on management is linked to western societies moving from high trust to low trust and from patient to impatient.
I'm aware that incentives are often counterproductive or insulting for white collar workers where there are elements of creativity in the job, but I feel like to get it to work you need trust which IMO cannot be scaled to big companies like Google.
FYI, I'm paraphrasing, perhaps badly "The puzzle of motivation | Dan Pink | TED". https://www.youtube.com/watch?v=rrkrvAUbU9Y
Even around 1900, it didn't matter if you were a genetic freak, you needed a barbell to win competitions.
In the past I dropped off privacy when it was too inconvenient. For example I dropped protonmail because of bad search, left Linux desktop for Windows due to missing software, etc, I still haven't found the sweet spot for LLMs yet.
For the rest, I'm currently running the full macOS, iOS, safari, Apple passwords and I'm decently happy with this middle ground.