HNHacker News
TopNewBestAskShowJobs

erwincoumans

930 karma · joined May 16, 2017

NVIDIA, combining Physics Simulation, Robotics & AI. https://twitter.com/erwincoumans
submissionscomments
erwincoumans··on Transformers from Scratch (2021)
Andrej Karpathy's 2 hour video and code is really good to understand the details of Transformers:

"Let's build GPT: from scratch, in code, spelled out."

https://youtube.com/watch?v=kCc8FmEb1nY

erwincoumans··on Ask HN: Open source LLM for commercial use?
Truly Open AI: LAION calls for a supercomputer to develop open-source AI, by replicating large models like GPT-4 and exploring them together as a research community.

https://www.heise.de/news/Open-source-AI-LAION-proposes-to-o...

erwincoumans··on 4000x Speedup in Reinforcement Learning with Jax
There is Brax, a differentiable physics simulator written in Jax. It includes Gym tasks such as Ant, Humanoid and more: https://github.com/google/brax It is not full MuJoCo but a good base to add more features. Aside from position based dynamics (xpbd) it features motion in generalized coordinates using the same accurate robot dynamics algorithms as MuJoCo and TDS (Tiny Differentiable Simulator).
erwincoumans··on Robot Learns to See in 30 Minutes (2022)
Likely local: "We build a custom model to predict the future to allow inference on limited compute."
erwincoumans··on How to Optimize a CUDA Matmul Kernel for CuBLAS-Like Performance: A Worklog
Really well written blog, explaining all the concepts introduced in details.

>> Profiling our naive kernel

I would highly recommend trying out NVIDIA NSight Systems to help profiling: it gives a lot of information while optimizing for CUDA (together with info on CPU, NVTX markers, Vulkan,OpenGL etc).

erwincoumans··on Rigs of Rods: free and open source vehicle simulator that uses soft-body physics
Indeed, you can add a Featherstone articulated body algorithm implementation for such cases, or direct solver with good performance (see Maciej Mizerkski talk on Roblox solver here: https://youtube.com/watch?v=P-WP1yMOkc4)
erwincoumans··on Rigs of Rods: free and open source vehicle simulator that uses soft-body physics
Actually, rigid body simulators using impulse based constraint solvers can simulate soft constraints (including soft contact), and you can control the stiffness from very stiff to very soft without becoming totally unstable. See this slide deck by Erin Catto: https://box2d.org/files/ErinCatto_SoftConstraints_GDC2011.pd...
erwincoumans··on Second Life on GitHub
Thanks John. SL devs should check out Roblox, plenty of fun experiences in there.
erwincoumans··on What if your entire worldview was just because of near-zero interest rates?
The 0.01% is temporary/new, due to the wealth tax declared illegal by the European Supreme Court. This link explains the situation around the "Box 3" wealth tax better: https://www.tilburguniversity.edu/magazine/supreme-court-net...

“In 2001, the legislature assumed that everyone could easily earn a 4% return on their assets in Box 3 – regardless of how they were invested – without taking any risk, but this has certainly not been the case since 2008. Savings rates have yielded much less interest, as have bonds, with interest rates as low as 0%. At the moment, we’re even seeing negative interest rates. But the legislature never adjusted that assumed 4% return. This resulted in a situation where, for many years, the wealth tax people paid far exceeded their actual income from wealth"

erwincoumans··on What if your entire worldview was just because of near-zero interest rates?
No, they use hypothetical yield (of over 5%). It applies to savings accounts, that had negative interest rates...

See my reply above.

erwincoumans··on What if your entire worldview was just because of near-zero interest rates?
Yes, the Netherlands has wealth tax, also known as "Box 3", and it includes tax on hypothetical yield on your savings accounts. The government got into issues with the European Supreme Court for this:

https://home.kpmg/us/en/home/insights/2022/05/tnf-netherland...

"The box 3 tax rate is assessed against a hypothetical yield. You are not taxed for capital gains or actual rental income. Instead, the Dutch tax office assumes that you enjoy a yield of up to 5.69% over your total asset value, irrespective if any actual gains are higher or lower(!)."

Note that actual savings interest rates were close to zero or even negative.

erwincoumans··on Building a Virtual Machine Inside ChatGPT
ChatGPT output: "I am not sure which specific programming languages or libraries were used to train my language model, as I do not have access to that information. Language models are typically trained using a combination of various programming languages and tools, and the specific technologies that are used can vary depending on the specific model and the research team that developed it. I am a large language model trained by OpenAI, and I use artificial intelligence (AI) and natural language processing (NLP) techniques to generate responses to text-based queries."
erwincoumans··on The impotence of being clever
Indeed, self-evaluating your smartness precisely seems unlikely: you are more likely more or less smart.
erwincoumans··on Extism: Make all software programmable with WebAssembly
I recall NaCL, that also provided a sandbox and had a standalone version next to the web browser integration.
erwincoumans··on Ubuntu's settings won't open after setting CPU to 'performance'
Agreed, Ununtu is way worse. Especially when Ubuntu performed a background update, and the NVIDIA GPU stops working properly. It happened several times to me, and a few times the GPU drivers were so hard to update that a reinstall of Ubuntu was quicker/easier.

This never happened to me in Windows.

erwincoumans··on My project is now an easter egg in Microsoft Flight Simulator
Fun, didn't know that. I recall both games, Maniac Mansion on C=64. Impossible Mission is the first game I recall with working terminals inside (but those terminals didn't play a full game although it likely could be done).
erwincoumans··on My project is now an easter egg in Microsoft Flight Simulator
That's cool! Like playing classic Doom inside Doom 3. Is there a list of games that let you play older versions from within?
erwincoumans··on 'Be' is nice, end of story
BeOS was fun. I recall attending BeGeistert and showing my Blender port (as a Not a Number/NaN employee) running on its software OpenGL driver (eventually I also beta-tested OpenGL hardware on BeOS). Be had a close knit community, with a similar passion as the earlier Commodore 64 'demo parties'. Official BeOS C++ API's included 'is_computer_on()' and 'is_computer_on_fire()': a sign that Be creators enjoyed working on their BeOS!
erwincoumans··on Laika, the space dog, and her one-way trip into orbit (2018)
Laikago, the quadruped robot from Unitree is also a homage to Laika: http://www.unitree.cc/e/action/ShowInfo.php?classid=6&id=1
erwincoumans··on Accidental Google Pixel Lock Screen Bypass
Mac seems mote secure in sleep:

"If your Mac has the T2 Security Chip (recent Intel-based Macs) or uses an Apple silicon chip (M1 family and future), security is significantly improved. The Secure Enclave in both systems uses encrypted memory, and has exclusive control over FileVault keys. The Intel CPU or the Application processor (M1) never sees the keys, and they are never stored in regular (unencrypted) RAM. Due to this, an attacker would only be able to extract encrypted keys (which can't be decrypted), and only if the system failed to prevent the DMA attack in the first place. These protections make it a lot safer to leave your Mac asleep."

From https://discussions.apple.com/thread/253568420

erwincoumans··on Accidental Google Pixel Lock Screen Bypass
Sleep mode could suspend all activity? You could encrypt all memory before sleep?

It doesn't seem unsolvable, as long as sleep (closing lid) suspends all activity.

(lock with background activity is different, lets discuss the sleep case)

erwincoumans··on Accidental Google Pixel Lock Screen Bypass
That sounds like a security issue. Why are disk encryption keys not evicted in sleep mode? Seems like no apps should be running in sleep mode?
erwincoumans··on The C64 OS Programmer's Guide
This C64OS video seems nice: https://www.youtube.com/watch?v=8nUosmUcckU
erwincoumans··on Bringing a dynamic environment to C: My linker project
It would help to replace pointers by integer offsets, and keep the base in only one location. Using offsets is also useful if you move your code to GPU.
erwincoumans··on A chill driving game with procedurally generate scenic landscapes
Any chance for joystick controls?
erwincoumans··on Using an Amiga in 2021: Making an intro
6502 assembler, good times with some SID tunes (or armsid) in the background :)
erwincoumans··on NVIDIA and nouveau
>> GPU may allow creating a cross-platform compute stack

That was the intention of OpenCL.

erwincoumans··on The Full Chess Cheating Report of Hans Neiman
You can use (the data of) statistical analysis to train a deep neural network to avoid detection. That may also help avoiding chess detection cheaters, so the moves are not perfect anymore.
erwincoumans··on D3wasm 0.4 – Doom 3 in WASM
Dhwem3 has a native macOS M1 (arm64) version that runs well: https://github.com/MacSourcePorts/dhewm3/releases
erwincoumans··on Playstation 2 Architecture
The PS2 architecture is implemented in the open source PCSX2 and plays "over 98% of the official PS2 library is considered playable or perfect". Amazing feat and well worth trying out: https://github.com/PCSX2/pcsx2 and check the Wiki documentation https://wiki.pcsx2.net/PCSX2_Documentation
← PreviousPage 4 of 16Next →