Do you own the GPUs or are you multiplexing on a 3rd party GPU cloud?
12 karma · joined April 1, 2021
Perhaps I'm stating the obvious, but you deal with this with lock-free data structures, immutable data, siloing data per thread, fine-grain locks, etc.
Basically you avoid locks as much as possible.
"What One Fool Can Do, Another Can. (Ancient Simian Proverb.)"