221 karma · joined December 29, 2022
[1] https://en.wikipedia.org/wiki/Vastaamo_data_breach#Backgroun...
> Our data comes from more than 20 open-source datasets of historical books and newspapers. ... We currently do not deduplicate the data. The reason is that if documents show up in multiple datasets, they also had greater circulation historically. By leaving these duplicates in the data, we expect the model will be more strongly influenced by documents of greater historical importance.
I found these claims contradictory. Many books that modern readers consider historically significant had only niche circulation at the time of publishing. A quick inquiry likely points to later works by Nietzsche and Marx's Das Kapital. They're possible subjects to the duplication likely influencing the model's responses as if they had been widely known at the time
A review page [2] mentions that this add-on is a peer-to-peer vpn, not having its own dedicated servers that already makes it suspicious.
[1] https://web.archive.org/web/20250126133131/https://addons.mo...
Can you name some works by the mentioned authors that might be called thought-provoking digests of some area of expertise?
For example, I once adjusted an Object Pascal interactive program (target: Windows/Win32) for the browser target (FreePascal compiler has the JS target). An intermediate result was a bunch of files that worked locally on desktop but struggled on mobile. With a little help from the SingleFile extension [2], I ended up with a single HTML file containing all functionality and content. It worked great, for example, in MiXplorer's internal HTML viewer. I can't recall the exact details, but the file:/// protocol still had issues in Chrome, Firefox, or both. Anyway, preparing a local address correctly with a keyboard is a challenge so let's just assume that having capable file managers running local html files is enough
Sure, to make this manageable, you need good tools that handle all sides of the task. But at least in theory, the format is fully capable. My only global issue was that the state for locally run HTML files is a kind of ephemeral entity, but for interactive multimedia files, you may consider this obstacle small.
Just as a thought experiment: what if the threshold for having a vote was tied to paying a positive amount of personal income tax, and the weight of each vote was proportional to the amount paid? How skewed might such a system be? My first reaction is that in countries with high inequality, the wealthy would disproportionately influence the outcome. However, on the other hand, if people avoid or minimize paying taxes, they would lose the power of a weighted vote, which theoretically could incentivize paying taxes in full.
Sometimes, a sense of time and real social interactions comes from small reflections found in nonfiction books of that era. Not 40, but 50 years ago-taken from a nonfiction book unrelated to politics: Lost! by Thomas Thompson , written in 1975. [1]
> Though he had opposed the Vietnam war, he considered himself a political moderate, certainly not a knee-jerk liberal who cried “fascist” at everything attempted by Richard Nixon
Honestly, I’m not expecting anything good from Trump in the coming years, but this line genuinely gave me hope that American democracy is still not in danger.
[1] https://archive.org/details/lost0000thom_j3f3/page/124/mode/...
It is also interesting that at first when I started using Perplexity I expected for it to understand my question semantically and then use some derivative (correct) terms to query the web. The reality is that, probably for the sake of speed, the web search is performed first, and then the results are summarized. This leads in many cases to a mixed, somehow embarrassing set of links where one obviously sees that not all links in the block are relevant. Maybe Google uses something similar and both tend not to present the block of links as distilled correct knowledge blocks. But Google made the top-right block smaller and relying on the scrolling so this embarrassing effect might be less pronounced.
> The authors note some limitations to their work. The group with “very dissimilar” education contained only 10 twin pairs. While this represents all such published individual data from the last century, it is a small sample size
Thanks, the study is interesting, but needs further research.
I'm not sure he assumes this, the author (Aaron Ryan) also was briefly interviewed at NPR [1] where the wording is neutral
And I think that's more so in country music than other genres, which have depended on computers a lot more. Country music has really prided itself on the authenticity in songwriting and in music. And there's a large segment of country music fans that don't even like things like Auto-Tune, and so I think asking country fans and artists to accept AI is a big pill to swallow for a lot of people.
The mystery of who is behind it is not solved, but for another AI artist, Xania Monet, there is more information. In this CBS News fragment [2], the real author of the AI hits, Telisha "Nikki" Jones, defends herself and even shares how she actually works with Suno to create the songs. It’s interesting because, this time, the lyrics are human-originated. To me, she seems like a mix of a music manager, music producer, and co-author all in one. Probably, after her talent is recognized, the label might offer her co-authors, musicians, and others to collaborate with and create hits with real people. But without this first step, when she had to rely on her own skills and opportunities, it wouldn't have been possible. Like an example from AI-less era - without the $7,000-made "El Mariachi," there wouldn’t be Robert Rodriguez as we know him.[1] https://www.npr.org/2025/11/10/nx-s1-5604320/breaking-rust-i...
[2] https://www.cbsnews.com/video/creator-ai-artist-speaks-amid-...
The "weakest" probably also involves selection bias. What HN comments are really good at is triggering associations for me with things I once read. Today I finally found what recently lived in my memory as a vague "scam" that used probabilities: the "stock market newsletter scam" from John Allen Paulos's book [1]. The scam works like this: at every step, two variants with different predictions are sent out for some market characteristic. Only those who receive the correct prediction get the next newsletter, which is again split into two prediction variants. This continues, filtering down to a final, much smaller subset of receivers who have seen a series of "correct" predictions. The goal is to create an illusion of super predictive power for that final group and then charge them a premium subscription price.
Maybe this kind of scam is too sophisticated or not as effective today (due to modern anti-spam measures), but I wonder what other kinds of "selection bias" scams exist today
Though, when we try to use it as a synthesizer of new knowledge (software, article, review), that's when the OP's thinking about protection makes sense.
It's interesting how cultural differences can make some life algorithms hardly work in some countries. I sometimes use a method to find people from my past by googling their full name, switching to the image results, and spending a manageable amount of time scrolling through them until I find the person. I've successfully used this method several times. The images are usually related to job activities or social media profiles. However, from your description, this approach probably won't work in China for at least two reasons: too many raw results and few or no social media results.
UPDATE: a follow-up question. If in a big company two or more figures happen to have the same full name and need to be exposed publicly (on a site or promotional materials), are there any tricks for this?
I would have agreed with you at the dawn of LLM emergence, but not anymore. Not because the models have improved, but because I have a better understanding and more experience now. Token prediction is what everyone cites, and it still holds true. This mechanism is usually illustrated with an observable pattern, like the question, "Are antibiotics bad for your gut?" which is the predictability you mentioned. But LLM creativity begins to emerge when we apply what I’d call "constraining creativity." You still use token prediction, but the preceding tokens introduce an unusual or unexpected context - such as subjects that don't usually appear together or a new paradoxical observation (It's interesting that for fact-based queries, rare constraints lead to hallucinations, but here they're welcome)
I often use the latter for fun by asking an LLM to create a stand-up sketch based on an interesting observation I noticed. The results aren’t perfect, but they combine the unpredictability of token generation under constraints (funny details, in the case of the sketch) with the cultural constraints learned during training. For example, a sketch imagining doves and balconies as if they were people and real estate. The quote below from that sketch show that there are intersecting patterns between the world of human real estate and the world of birds, but mixed in a humorous way.
"You want to buy this balcony? That’ll be 500 sunflower seeds down, and 5 seeds a day interest. Late payments? We send the hawk after you."This is my pure speculation, but it seems like for a product like this there is no ideal path for Apple. Two scenarios (there may be more):
* Make it an evolutionary experience, mostly regarding the apps. It's like how the iPad and iWatch related to the iPhone. Both projects were successful for many reasons, but having thousands of apps continue working and adding new value was definitely one of them. But in this case, Apple needs to invent these new values, which is not so easy. For example, a visual notification device is one of the use cases (like now you get notifications directly to your eyes from dozens of existing apps), but this use case is not big enough to be an anchor.
* Make it a revolutionary device, like the iPhone was. So mostly new use cases, apps, SDK, etc. But this requires time, resources, and Jobs's skills to make it work. And what's interesting, many of the potential "revolutionary" use cases are definitely not for everyone, which would make this project less appealing for Apple. For example, I can imagine a digital/AI assistant recording/decoding everything around you and working as your second brain/memory device. I'm sure Stephen Wolfram will be one of the first users of such a device (see his own description of his everyday life [1]), but I'm not sure there will be millions of such users.
According to some leaks and hints, probably the second path is currently underway at Apple. But it needs time for both the hardware and software parts. Maybe even more time for the software.
[1] https://writings.stephenwolfram.com/2019/02/seeking-the-prod...
Let me mention my recent app for an alternative view of the HN comments (Hackeray) [1][2]. I'm sure this is not for everyone, but for me this view really helped to read the comments more clearly and basically absorb any big discussion here.
[1] https://en.wikipedia.org/wiki/The_Idea_Factory
[2] https://en.wikipedia.org/wiki/Bell_System#1956_Consent_Decre...
You probably had Nicaraguan Sign Language [1] in mind. I think it’s a good example of the human brain’s ability to invent something and acquire knowledge easily. What I tried to show with my comment is that when human intelligence is discussed, it’s easy to refer to all instances of human achievements around us, but they are essentially accumulated cultural knowledge. Because of this, we tend to overestimate our intelligence, at least when comparing an individual human with an individual primate of another kind.
So, it’s also interesting why humans are probably unique in this ability to pass on and accumulate information, while other apes (and crows) limit this to skills like retrieving ants with sticks and breaking shells with stones.
The quote that is interesting in the context of the fast-pacing LLM development is this
> The Dark Matter Developer will never read this blog post because they are getting work done using tech from ten years ago and that's totally OK
[1] https://www.hanselman.com/blog/dark-matter-developers-the-un...