john hawks weblog

paleoanthropology, genetics and evolution

arXiv

  • "We find it hard to see what publication would achieve at this stage"

    Mon, 2012-08-27 21:05 -- John Hawks

    Theoretical physicist Terry Rudolph shares a story about preprints and the editorial process at a top science journal: "Guest Post: Terry Rudolph on Nature versus Nurture". In short, there was no problem posting a potentially interesting physics paper on the arXiv, and then getting it reviewed by the journal. But when the authors posted a follow-up preprint, it sabotaged the "interest" of their first submission:

    While it mildly rankles that my own participation in that “wide debate” was curbed by the blurry lines of their own policies, I’m not particularly upset by the episode – perhaps indicative of my well documented own laissez-faire attitude to publishing, but perhaps because I know the result is ultimately more important than the journal it appears in.

    The ironic part is that Nature wrung the news value out of the first preprint with coverage from its news division. Rudolph's story gives the appearance that the journal was happy to promote the work before it accepted the paper, but later claimed it was not newsworthy.

    I don't really have any problem with journals pursuing papers that are newsworthy. My problem is that these journals make papers appear newsworthy by their control of information flow. I've said it before ("The costs of publication delays"): We need to eliminate the myth that publication itself is a newsworthy event.

  • The costs of publication delays

    Sun, 2012-08-19 21:54 -- John Hawks

    Joe Pickrell has written a valuable post on Genomes Unzipped about the future of publication in genetics: "The first steps towards a modern system of scientific publication". One thought-provoking passage:

    In my experience, this lag time [between submission and publication] is on average about six months, with a non-trivial long tail of papers that take much longer. To put this in context with some back-of-the-envelope calculations, let’s define a unit of time called a Scientific Career (SC), and let 1 SC equal 30 years. If there are 50,000 papers published in biology per year (this number is somewhat random, but probably within an order of magnitude given that about 500k papers are added to PubMed per year), and on average each paper takes 6 months to go through the review process, then each year ~800 Scientific Careers are spent bringing papers from initial submission to formal publication. It would be a laughable to argue that 800 SCs of research or value have been added to the papers during this process (let’s be honest–for most of that time the papers are just sitting on someone’s desk waiting to be read). The system of pre-publication peer review thus dramatically retards scientific progress.

    Pickrell is arguing only that preprints help to address this unnecessary delay. I agree. In biological anthropology, the lag is typically much longer than six months.

    Of course some of the delay happens when papers are sitting on reviewers' or editors' desks. This situation could be improved if reviewers were paid or given formal recognition for their efforts. Also, papers are substantially delayed when rejected by a journal because they don't match the journal's focus or desire for news value. Authors are partly to blame for mistargeting these manuscripts. If preprints were routinely posted, the authors would suffer the pain of resubmitting without having their work remain unavailable to everyone else. Of course, this reduces news value of publication, but we need to eliminate the myth that publication itself is a newsworthy event.

    The post has an excellent, long comment by commenter asdf, featuring this:

    The solution: adopt the culture of open source, where source is assumed to be fragile and bug reports are met with patches. Reject the culture of academia, where “peer reviewed” papers are assumed to be correct, while corrections and retractions carry a career penalty.

    She's describing the myth that getting your work published is the point when it becomes valuable. You can see how that myth hurts the public by conveying a mistaken picture of how science works. It also hurts science by creating incentives for misbehavior by scientists.

    Mostly unrelated: While writing this, I was reminded of my post from last year, "Peer review in Castle Wolfenstein".

Subscribe to arXiv

Neandertals

For years, I've worked on their bones. Now I'm working on their genes. Read more about the science studying these ancient people.

Denisova

From a finger bone of an ancient human came the record of a completely unexpected population. My lab is working on the science of the Denisova genome.

Acceleration

The advent of agriculture caused natural selection to speed up greatly in humans. We're uncovering some of the ways that populations have rapidly changed during the last 10,000 years.

Malapa

Just outside Johannesburg, the Malapa site is producing some of the most exciting finds in human evolution. This site is the headquarters of the Malapa Soft Tissue Project.