I wonder if someone could integrate this into a more coherent long-term platform.
649 karma · joined August 28, 2020
I wonder if someone could integrate this into a more coherent long-term platform.
But the effect is bigger than that, by allowing skilled immigration, it makes US universities and tech companies the best in the world, at the very least seen as such, which has tremendous larger effects.
It’s not a coincidence that we have the largest tech industry, and it’s not because we magically have smarter people.
My understanding was that in many states, it's mostly just paper requirements and not any strict testing, etc.
- Working with large remote datasets/clusters - Needing to share visualizations with others [both interactive, and pre-recorded/controlled] - Being able to easy switch between N runs to look at data/results over time
Concretely:
- Currently it seems you need to forward multiple ports, and for each new session you need to re-connect. My memory is foggy but I found it was a lot of hassle to just connect a thin-desktop client to a remote backend.
- The support for baked-html is great, but it has limits (namely I was hitting some size limitations) and it would be cool to have a server that can read rr files from disk and stream them on-demand [e.g., point to a directory and let the user select]
- Generally speaking, I found the workflow difficult to integrate to the typical ML setup. Obviously not a priority for rerun but I think a little improvement [like the point above] could help a lot.
- A built-in screen recording feature would be great. I spent a lot of time screen recording and re-sharing clips.
Again, these are mainly nitpicks, love the tool overall and have recommended it to several people.
The remote client/server streaming has a bit to go, but just the option to use it in a browser is a game-changer. All the previous web-based tools that I’ve come across have been either very limited, or require significant manual setup.
Every time I want to rewrite a shell function in python, I always hesitate due to the slow startup.
This is especially the case for something like this where it’s a relatively obvious idea and the evaluation matters more.
The issue is that their current wording is deceptive.
At least I personally used it a lot, and knew several people that did.
This repo has a lot of handy utilities but also a bunch of clean implementations of common models, metrics, etc.
In other words, this is more for writing new models rather than inference.
If you're talking about the total employee makeup of a current self-driving company, the number might be ~10-50%, depending on the company.
But if you take the subset of employees that work on software, this number is much much larger. There's lots of typical SW dev needed for GenAI (think data pipelines) but a good chunk of ML-folks doing self-driving work can be useful on GenAI as well.
For me it’s such a shame as I would definitely use it much more often if the language and environment were closer to a typical coding workflow. It’s just such a hassle to have to use a standalone desktop engine, a weird editor, and a quirky language [at least at first] with few 3rd party libraries.
Everything else isn’t really core to the issue [even that the update script silently failed].
Updating your code: Easy. Updating 10 different libraries that you depend on but don't know anything about: Not so easy
Windows randomly quit, take forever to open, there are always indexing issues, etc. Locally everything is great, but remote is completely unstable.
I’ve since moved all my data out of iCloud Drive (although I still use it for their other services like photos). I thought my case was just special but I’ve encountered similar issues helping friends/family.
It’s beyond me how they get away with people thinking it “just works” and how they can’t manage to make a simple cloud sync service.
Framework support is one thing, but what about the million standalone CUDA kernels that have been written, especially common in research. Nobody wants to spend time re-writing/porting those, especially when they probably don’t understand the low-level details in the first place.
Not to mention, what is the plan for comprehensive framework support? I’ve experienced the pain of porting models to different hardware architectures where various ops are unsupported. Is it realistic to get full coverage of e.g., PyTorch?
If they really need a new op, they add it.
To my knowledge, most inferencing (at least for simpler models) happens on cheaper, slower GPUs that have better throughput/dollar.
Are recommendation/ranking models large enough to take advantage of this? I don't think these cards are generally competitive in throughput/$.