This article does not answer either of these fundamental questions.
672 karma · joined December 26, 2009
This article does not answer either of these fundamental questions.
While some effort to standardize is important, it also waste a lot of time setting up a specific set of experimental conditions that may not have much resemblance to the conditions that obtain in the real world. In my opinion, we learn much more by taking someone's existing result, thinking through the consequences and then designing well-powered experiments that probe the assumptions, mechanisms and applicability of the result. With critical eyes and diverse systems, we won't fool ourselves.
One more note: if this topic interests you, please read The Structure of Scientific Revolutions. If you are unfamiliar with the book, I guarantee it will completely change how you think about science as a human endeavour and make you much more comfortable with the existence of long periods of time where science just gets some things wrong.
For instance, in the field I work in you have to spend days to months waiting for tumors to grow and then go and treat the animals every day for a couple of weeks with an IV drug (weekends too!). That is a a lot of work and at the end only tells you one piece of information about the drug: does it slow tumor growth in this one experimental model. It may in fact do that -- and you may get a really great p-value if you increase the number of mice -- but you still need to study the drug's pharmacokinetics, tissue distribution, in vivo mechanism of action (assuming you already know the in vitro mechanism of action). These are not just optional experiments that we require today to publish: this kind of work is essential to presenting a story about a new drug. It's not just about what it does, but how it works and universalizable it is.
They are critical and contexualizing when it comes to certain topics. Why not when it comes to "data" driven observations?
However, I don't think the author's premise is well founded. Every scientist dreams of publishing a beautiful, fully formed scientific discovery that emerges like Athena, immediately rocking their field and changing the destiny of mankind.
Most science is nothing like that. Most scientific results are comprised of unclear results in a specific model system that may have only speculative relevance to the real world (or to problems that people care about). Presentation, and public consideration and public discussion helps to refine models and cross-pollinate ideas that can lead to major discoveries. Little is gained by keeping data absolutely secret until a scientist is ready to publish.
>Now skip forward from 1940 to 2010: apart from our obsession with little glass rectangles, the world would be fundamentally familiar.
Disagree completely. The technology and information economy revolution means that a socially well-adjusted blue collar, white collar or even field-hand in 1940 cannot compete at all in 2010 at the same job.
A pilot project of peer review as a service could ferret out these issues and come up with solutions. Here's a couple of ideas: (a) let authors give feedback on reviews for editors to consider when assigning this reviewer to future manuscripts, (b) require public disclosure of who reviewed the paper (this presents other problems, but should at least be considered), (c) editors can bring on 4th or 5th reviewers as needed if authors/editors/reviewers feel it is warranted (after seeing all 3 initial reviews)
2. Time is worth more than money. Remember it's not only the PI but also the postdocs and grad students who are not productive while they work on review/resubmission related work. I bet many labs would be glad to pay this amount of money for a single review process.
The goal would be for single-review-per-manuscript to be able to replace journal reviews in most cases. Sure, some top flight journals may require additional review--and that's fine--but those should eventually be outliers, not the norm.
I don't agree about the perception issue for a reputable source which is providing a tangible product. The authors end up with a peer reviewed manuscript that is citable. Call it biorXivGold or something like that and you're done.
^^ This red team/blue team (peer review) on this idea is a microcosm of the best part of science :)
My proposal is a bit different because it establishes a preliminary and public review process that is separate from "publication." You cannot take your PLoS One article and now get it published at Nature or Science. But you could do that if your paper was "reviewed" at bioRxiv, meaningfully improved and corrected, and then submitted for publication elsewhere.
One of the reasons why scientists are currently dependent on the journal industry is because the journals control peer review. Unfortunately, instead of merely reviewing manuscripts for correctness, the journals link peer review to "impact," which is a prospective measure of importance (i.e. whether they are likely to get many citations). Every journal you submit your manuscript to will put it through a new round of peer review looking for both correctness and impact. Massive amounts of time are wasted by working scientists and journal editors attempting to prospectively "grade" manuscripts on how important they will be (along with checking the correctness of the manuscript). Upon rejection for either correctness or impact, authors resubmit their manuscript to a lower tier journal (+/- revision) and wait for the next round of reviews. Rinse/repeat. Eventually, assuming the paper is not awful, it will be published.
How could we do it differently?
One idea is to disentangle impact from correctness and eliminate the journals from peer review. Scientists already review each others manuscripts pro-bono, so here's a proposal: Scientists submit manuscripts to bioRxiv as "pre-prints" for a nominal fee (say $1000) and request peer review. An editor selects 3-4 potential reviewers and reviewers are paid a nominal fee (~$150) to perform the review. The money paid by authors covers the reviewer fees and editors salaries. After peer review, authors can decide whether they want to submit their articles for additional peer review and fancy publication in a journal.
Impact is thereafter judged only by how many citations a paper gets, not which glossy magazine it gets published in.
There are two reasonable hills on my way to work (and I'm a sweaty guy) so I've had to learn to deal with the inevitability of sweating.
The NUMBER ONE most important change I made was getting a rack and an Arkel saddle bag. Not carrying my backpack on my back cut down my sweating a TON.
During the winter I wear regular clothing with uniqlo v-neck airsim undershirts. I will sweat a little but generally I shed layers as I get hot. I've switched from cotton shirts and blue jeans to mostly flannel shirts and mostly black jeans -- both of which help to cover any incidental sweat spots. I've also switched to more breathable sneakers for daily use. I'll bring a change of shoes clothes if I need to be dressed fancier.
During the summer, with Manhattan heat and humidity, there's no avoiding getting sweaty. I bring a change of clothes, cool off for 5m after parking my bike and then change and walk into work. Not ideal, but the health and exercise benefits significantly outweigh the downsides.
Also: this is a really great, really stellar thread.
For instance, a recent study in Nature Medicine[1] showed that you could decouple the positive analgesic (pain relief) effects of opioids from the negative effects of increased tolerance to opioids and increased sensitivity to pain. This is critical because tolerance to the effect of opioids and increased sensitivity of pain to opioids is part of what drives increased use and eventually abuse of opioids.
The practical upshot of this study (if validated) is that you could potentially take a smaller amount of opioids and not have to increase your dose over time to get the same level of benefit. This could severely limit the mortality associated with opioids.
I am hopeful that we will get through the opioid crisis in this country if we invest money in fixing the underlying physiological problems associated with these drugs.
[1]http://www.nature.com/nm/journal/v23/n2/full/nm.4262.html
Only careful prospective trials will identify sensitive and specific diagnostics. Those will be the winners (and they will probably be academics).
For storage I use Papers (http://papersapp.com/). Highly recommended if a little pricey.
Do you really think advertisers would pull their funding from Vox or HuffPo absent very offensive headlines like the ones on Breitbart?
No we're not. We're talking about reaching out to companies advertising on websites that contain both broadly offensive (e.g. against women) and specifically hateful (e.g. against certain individuals) rhetoric to let them know these ads exist.
>Now we're talking about firms refusing to work with one another based on political differences. Is that REALLY the society we want to become ?
You don't have to get into bed with people you find rude and offensive. That's a cardinal rule of an open society. Saying "Sir, I find your content offensive and I will not pay you to show ads to your visitors" is discrimination in only the sense that companies can discriminate between whom we want to do business with.
>Just because it is a different point of view does not make it fake or hateful or undeserving of ad dollars.
Without quibbling over whether some of their content is hateful (I think it is; you disagree), what's wrong with letting the free market de-value ads run on their network? What's wrong with attacking their business model? Companies don't have to run ads next to headlines like "Would you rather your child had feminism or cancer?" That's the free market at work.