15 karma · joined July 8, 2011
In my experience as ex-academic, the above is all too true in too many computational fields (and many sub-fields of CS). So I ask what scientific value (or any kind of value, for that matter) is being generated by grinding out publications with results that won't be repeatable?
-Publication pressure makes it such that research progress has become significantly harder to gauge (e.g.: it's become uncommon for results to get reproduced) across many fields (statistics, machine learning, the health sciences, which I've done work in for over 7 years at a highly respected institution)
-Balkanization of research fields where problems become increasingly exotic and narrowly focused to the point of being contrived (all the better for publishing papers of course)
-Increased difficulties in securing research funding or employment (more temp jobs though);
-Arbitrary metrics often being used to judge one's work. Example: if you do theoretical work, reviewers can reject your paper for lack of "applications"; if you do applied work, they can reject for "lack of theoretical depth" (what either of these terms mean in 90% of cases is arbitraily defined by a single reviewer who just wanted to torpedo your work).
-In some fields, entire mafia groups have formed that rigidly control the review process for that field, which means good luck to you if your work competes with theirs and you're submitting a paper/applying for grants
-Lack of accountability as to how research dollars are spent (vis-a-vis the public's interests)
-...
BTW, I say the above as someone who did a lot of enjoyable open-ended research as a grad student.
We've got mobile/desktop web apps and Android/iPhone native apps set up. We're looking for feedback, so let us know what you think!
The fact that years ago, life scientists easily could have adopted an ArXiV-like model for publishing, and chose not to, is quite telling. It suggests a far deeper problem with incentives in (general) academic culture to publish and that article availability is not going to affect that at all. As someone who spent >6 years Ph.D./PostDoc (bioinformatics, stats and CS), I can say that the vast majority of researchers have no genuine incentive to take action. Protesting against Elsevier online in the comfort of your office is one thing, but having to publish X>10 papers/yr to get tenure/brownie points within your department is another.