598 karma · joined June 13, 2017
Relevant for the HN crowd is the Journal of Open Source Software: joss.theoj.org.
[I am an editor at JOSS]
The reason that we do research is not simply so that we can produce papers and hence amass knowledge in an abstract sense. A huge part of the academic world is training and building up hands-on institutional knowledge within the population so that we can expand the discovery space.
If I went back to cavemen and handed them a copy of _University Physics_, they wouldn't know what to do with it. Hell, if I went back to Isaac Newton, he would struggle. Never mind your average physicist in the 1600s! Both the community as a whole, and the people within it, don't learn by simply reading papers. We learn by building things, running our own experiments, figuring out how other context fits in, and discussing with colleagues. This is why it takes ~1/8th of a lifetime to go from the 'world standard' of knowledge (~high school education) to being a PhD.
I suppose the claim here is that, well, we can just replace all of those humans with AI (or 'augment' them), but there are two problems:
a) the current suite of models is nowhere near sophisticated enough to do that, and their architecture makes extracting novel ideas either very difficult or impossible, depending on who you ask, and;
b) every use-case of 'AI' in science that I have seen also removes that hands-on training and experience (e.g. Copilot, in my experience, leads to lower levels of understanding. If I can just tab-complete my N-body code, did I really gain the knowledge of building it?)
This is all without mentioning the fact that the papers that the model seems to have generated are garbage. As an editor of a journal, I would likely desk-reject them. As a reviewer, I would reject them. They contain very limited novel knowledge and, as expected, extremely limited citation to associated works.
This project is cool on its face, but I must be missing something here as I don't really see the point in it.
It seems to me that with the transformer model world we now live in, utilities like these are excellent at generating things that appear in many tutorials/posts/etc. However, there's little-to-no evidence that they are able to generate anything truly custom. For instance, any application requiring any significant level of domain-specific knowledge (your last point), and given the model's architectures there's no reason to believe that will occur. What is it that makes you so confident that will become a possibility?
What’s the deal here with liability and accountability? That’s a serious problem when considering using these for anything other than toy problems.
Consider, for instance, particle-based simulation data (loading that into any database is a waste of time...), or a set of images that you need to perform non-standard individualized processing on (again, a waste of time).
Stuffing stuff into postgres or clickhouse is great for your typical 'data science' workflows where data is consistent and the problem is 'oh no our transaction volume has increased 100x'. But in other (some would claim more interesting) cases, using database systems is unhelpful.
We are an academic department hiring a primarily front-end developer to work on data visualization, analysis, and sharing tools for the Simons Observatory.
The Simons Observatory (SO) is a millimeter-wave survey experiment currently being built for observations from the Atacama Desert in Chile, with a variety of scientific goals from probing the early universe to detecting millimeter-wave transients.
SO is a medium-size academic collaboration with around 500 members. The Data Delivery group is a small team composed of around 5 people working on tooling and deployment.
https://wd1.myworkdaysite.com/recruiting/upenn/careers-at-pe...
The hardware (at least gen 1) has around a 1 year lifespan due to the quality of the seals. You can only get a warranty replacement once. Mine literally fell apart once when I put it on, then the other one was shorting out in the case.
They don’t allow heart rate sharing over Bluetooth. Kind of a niche feature but this stops you from using it as a heart rate monitor with a bike computer or other exercise equipment.
In the end, after the support refused to service my watch for a warranty repair, I just switched to a Garmin Venu 3S, which I like, but I do miss that semi-analogue design.
(Yes, I am aware that the 'algorithm shows you what you engage with' but no matter how many times I click 'not interested' I seem to be in Indian thirst trap hell)