HNHacker News
TopNewBestAskShowJobs

WiSaGaN

1,051 karma · joined September 18, 2015

submissionscomments
WiSaGaN··on DeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Days
Tencent recently bought 100k-200k H20 to serve R1. [1] I think it's not clear open source will tank nvidia price. And you won't place a lot of bets if the outcome is anywhere from certain.

[1]:https://aiproem.substack.com/p/ai-at-the-speed-of-light-tenc...

WiSaGaN··on Statement from Dario Amodei on the Paris AI Action Summit
I think the current US administration significantly undermines the framing of democracy versus authoritarianism. As much as Dario may want to push alternative narratives, most AI practitioners—who have no financial ties to OpenAI or Anthropic—likely view this as an attempt to squash competition from open weight models.
WiSaGaN··on Musk-led group makes $97B bid for control of OpenAI
Fixed! Thanks!
WiSaGaN··on Musk-led group makes $97B bid for control of OpenAI
I think this is a negotiation tactic that aims to eventually block OpenAI's transition to for-profit.
WiSaGaN··on Gemini 2.0 is now available to everyone
They won't after OpenAI used transformer and refused to give back.
WiSaGaN··on Carl Sagan Predicts the Decline of America (1995)
The demon haunted world was my favorite book back in my college years more than 20 years ago.
WiSaGaN··on Huawei's Ascend 910C delivers 60% of Nvidia H100 inference performance
What if I told you most Chinese people really are more eager than the "CCP" to take over Taiwan?
WiSaGaN··on Fair Pricing
You are really underestimating how many users just forget they have such unused subscriptions, and how much of subscription based company monthly revenue is those that are not used at all.
WiSaGaN··on Introducing deep research
SearchGPT is bad because its underlying model is not a reasoning one. Deepseek one mentioned above is closer to deep research than searchgpt.
WiSaGaN··on How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server
Well you don't need to worry unless you are already on the list.
WiSaGaN··on How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server
I think the main point of local model is privacy set aside hobby and tinkering.
WiSaGaN··on OpenAI O3-Mini
I did math tests. Probably you did coding.
WiSaGaN··on OpenAI O3-Mini
My vibe question checking suggests otherwise. Even o3-mini-high is not as good as r1, even though it's faster than r1. Considering o3-mini is more expensive per token. It's not clear o3-mini-high is cheaper than r1 either even r1 probably consumes more token per answer.
WiSaGaN··on DeepSeek's AI breakthrough bypasses industry-standard CUDA, uses PTX
They are definitely step function improvements in regard to inferrance cost of the same level of reasoning intelligence.
WiSaGaN··on DeepSeek releases Janus Pro, a text-to-image generator [pdf]
Americans need to understand that the Chinese are not obsessed with the US. They don't have a saboteur mindset. They want development not because they want US to fail and China to win. It's really sad to look at US state of affairs right now. It used to have a mindset if abundance. It definitely doesn't right now.
WiSaGaN··on The impact of competition and DeepSeek on Nvidia
Deepseek inference API has positive margin. This however does not take into account R&D like salary and training cost. I believe OpenAI is the same in these aspects, at least before now.
WiSaGaN··on Citations on the Anthropic API
This is actually good. I expect them to utilize this in code editing as well if there is some real efficiency gain under the hood.
WiSaGaN··on Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
The one your laptop can run does not rival what OpenAI offers for money. Still, the issue is not whether third party can run it, it's just the OpenAI seems not putting API as their main product.
WiSaGaN··on Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
Not necessarily. DeepSeek will probably only threaten the API usage of OpenAI, which could also be banned in the US if it's too sucessful. API usage is not a main revenue for OpenAI (it is for Anthropic last time I checked). The main competitor for R1 is o1, which isn't gnerally available yet.
WiSaGaN··on Poland fumes over US block on AI chips
Brzezinski wrote about US not wanting an integrated Eurasia (the heartland), so that Europe can be more dependant on the US. Germany used to have more integration which make its industry thrive because it can take advantage of Russia's cheap energy and China's industrial goods for its industry. Ukraine war completely changed that, which marks the first time since World War II that Germany has faced two consecutive years of economic decline.
WiSaGaN··on It sure looks like Meta stole a lot of books to build its AI
The current copyright system is clearly broken. Copyright itself is not a natural right but a construct that was created relatively recently to incentivize innovation within society. Currently, we still want to train models using copyrighted materials. What we don’t want, however, is for companies to use these materials without giving back, especially to the content creators themselves, such as book authors, publishers, Stack Overflow answer writers, and Stack Overflow as a platform. We need to find a way to properly compensate these contributors to keep book writing, answer writing, and other creative efforts going, preferably while keeping the content publicly accessible. In the future, I hope we can figure out a model that might draw inspiration from music streaming (though perhaps not exactly like it).
WiSaGaN··on DeepSeek R1
If what here says is true: https://x.com/teortaxesTex/status/1880768996225769738, then R1 may as well just be the better model. You can scale up R1 with lower token count to achieve better than o1 high results.
WiSaGaN··on DeepSeek R1
This is r1 not r1-lite-preview. Supposedly r1-lite is a much smaller model, where r1 here is the 600+B MoE, same size as Deepseek v3 they released earlier.
WiSaGaN··on FrontierMath was funded by OpenAI
In their benchmark, they have a tag "tuned" attached to their o3 result. I guess we need they to inform us of the exact meaning of it to gauge.
WiSaGaN··on OpenAI's Economic Blueprint
It's interesting that nvidia takes somewhat opposite position on this "restricting adversarial nations" perspective. I think OpenAI wants the us government to restrict open source model such as deepseek or qwen from being accessed by US public and preferably other western nation by using leverage on those nations' ability to access AI chips from nvidia. It's pretty cunning strategy to build regulatory capture while using other company's market power behind the usual good vs bad rhetoric.
WiSaGaN··on Reflections
I think the problem exacerbates as he tries so hard to appear more sincere and interesting than he truly is.
WiSaGaN··on A path to O1 open source
I think it adds correct incentive to the public discourse so that you don't do bait and switch against public good will.
WiSaGaN··on XiangShan – Open-source high performance RISC-V processor
Is there anything that the Chinese can do that's not seen as a threat to the American people?
WiSaGaN··on 30% drop in O1-preview accuracy when Putnam problems are slightly variated
I don't think this proves that the LLM is just "pattern matcher". Human makes similar mistakes too, especially when under time pressure (similar to non-reasoning model that needs to "use system one" to generate answer on one go). This is further evident that if you specifically ask the models to pay attention to traps, or just ask follow up question "are you sure?", then they usually can get it right.
WiSaGaN··on 30% Drop In o1-Preview Accuracy When Putnam Problems Are Slightly Variated
There is also a curated benchmark just for those famous problems slightly variated: https://github.com/cpldcpu/MisguidedAttention/tree/main/eval
← PreviousPage 3 of 11Next →