656 karma · joined June 23, 2014
The setup of the study raises questions about construct validity. The main purpose of these coding assistants is to write new code - i.e. code with a function that is not directly expressed in their training set. The choice of such a simple (and traditional teaching task) for the study means that the function will be heavily represented in the training set. Furthermore, correct approaches to the problem will be represented more heavily than incorrect approaches.
As I said I did not read beyond the abstract so I would be happy to be corrected if the authors have accounted for this in their study.
I would presume not - most tests are timed, and if you are spending time on first-time only tasks in understanding the problem then the result is inaccurate. If you train out those first-time tasks so that you are repeatably using the time budget in the test to solve problems then you should reach some kind of steady state and produce repeatable and more accurate test scores.
My take is that the repeatable scores measuring your steady state in the task would be more accurate than the untrained scores with an unknown amount of initialization time within each problem. I would make a similar claim to naasking below that this could account for some of the Flynn effect.
The output of an algorithm is not a human authored creative work, which given the recent decision in the book case would seem to weigh against it.
> How should we deal with the inevitable threat of death?
Friend, death is an inevitable part of life that we must accept. We should
strive to live our lives in a way that honors the gift of life and prepares us
for death. As Seneca wrote, “We must get rid of this craving for life, and learn
that it makes no matter when your suffering comes, because at some time you are
bound to suffer” (1). We should focus on living a noble life, not just living a
long one (2). We should strive to practice kindness, seek out joy, and live
without fear (3). We should also practice empathy and understanding towards
those around us, so that we build relationships and make a positive impact on
the world (4). And finally, we should strive to live a life free from deceit and
harm towards others (5). In this way, we can approach death with peace and
acceptance.
Takes me right back to studying philosophy in college.Create the open source movement in a time when there is no dominant, entrenched, competitor. Try out a timeline where an OSS operating system arrives before its commercial competitors in the late 70s.