In defence of a Public Peer Review System

Scientists are used to having papers rejected. It comes with the territory, but usually the reviewers had some good reason — and give it to you — to reject the manuscript in the first place. Now this . . .

Many times the reviewer knows what he’s doing and the comments actually help improve the paper, but sometimes the reviews are just plain incompressible and look like they were written by a monkey punching a keyboard while watching themselves on the mirror.

I’ve seen reviewers showing a total lack of understanding about the subjects in hand, being partial, being biased, or worse, not even being able to write a sentence in English. Some reviewers I’ve read, wrote in some language similar to English that until today none of the authors or the editors have been able to understand. A mystery for the science historians of the future. Worse, there are reviewers that protected by anonymity are bluntly rude. Real douchebags. This was another of these cases.

It came from a reviewer saying that the authors should consider finding some male scientist to co-author a paper that was authored only by female scientists. Worse, he went on rambling about the marginal superiority of male scientists. You can get the details of this particular case at RetractionWatch. The tweet above is just an illustration of this reviewer medieval thinking.

A matter of Accountability and Public Peer Review

This leads me to think that we urgently need to end this lack of accountability in the review process. We need to quickly implement Public Peer Review. The idea is that first drafts go to an online repository, like arXiv for example. Reviewers will do their work and publish their reviews as comments in the repository. No anonymity, no protection of douches hiding behind the journal editors. They can still send private emails to the editors, but then what they write publicly has to match what they write privately. Reviews should be public. Authors can improve on their paper and submit a new version. At this point, everyone knows what is going on. Good reviewers will be praised by their scientific acuity and honesty. No one will keep saying things behind a blind knowing they will not become exposed to ridicule. It’s time to expunge those douches by exposing them publicly.

I imagine that some authors, editors and reviewers won’t like this open process. In any case, I imagine that it might be possible to keep the process private until sometime before publication. After publication, this online repository should become available so anyone could trace back the process. I prefer it to stay public always, but I imagine that some authors would prefer to have it closed mainly when collaborating with industry and NDAs were signed.

In any case, I think that the gatekeeper of this should be the author of the paper, not the editor or the reviewer. When submitting a new article the author should be able to keep it private for some time — say 1 month — after the last reviewer submitted his review. This is to give time to the authors to respond to the reviewers comments with a corrected version. After that month passes, the paper and comments should be public. Obviously the authors can go public with the process anytime before that date.

Finally, with all this changes, I also think that all papers should have a byline with the reviewers in the final print. What is the problem of having “This paper was reviewed by X and Y, reviewers comments are available online at HTTP…” in a footnote of the first page? Credit is due to where credit is due. Give reviewers credit for their good work and let the scientific community judge them when they are not good. Also, many other scientists, namely junior scientists starting their careers could learn from good reviewers. They could improve their own reviews by seeing how good scientist were doing theirs.

Being public about the process, is the first step to show the quality of your work. I don’t know why so many are afraid of having their work be publicly scrutinised. In a time where versioning is so simple — git is 10 years old now — where tracing back changes and accountability for actions is so important, I don’t understand how we are still in the feudal ages of protecting reviewers identities. Can it be because most reviewing work IS NOT PAID by journals and they just don’t care to do a quality work? If that is so, why keep this BROKEN SYSTEM?


  2015/05/01 9:14 AM Follow @sixhat

Can you park your car like this?

One of the problems with cars is that they take space. A lot of space, mainly when they are not being used. A research project is developing robots that could make the task of parking cars a totally different experience.

The authors claim that “a swarm of robots is able to extract vehicles from confined spaces with delicate handling, swiftly and in any direction. The novel lifting robots are capable of omnidirectional movement, thus they can under-ride the desired vehicle and dock to its wheels for a synchronized lifting and extraction. The overall developed system applies reasoning about available trajectory paths, wheel identification, local and undercarriage obstacle detection, in order to fully automate the process.”

This is one amazing idea, and while right now they are probably targeting the security forces that need to deal with badly parked cars and potential threats to security, I imagine that these would be great in managing parking silos. One could just drop the car at the entrance and a group of robots would take the car and park the car in the silo as to optimise the space available. No more having to put with those drivers that need the space of three cars to park a CORSA.

Well, in any case the European team of AVERT is going to present this work on a conference, but I see a lot of potential in their idea to make this into a commercial success. The preprint of the paper is available for download.

In a not so far away future robots will replace valets and optimise parking space in silos. Great!

  2015/04/28 6:23 PM Follow @sixhat

Your Grandfather’s Oldsmobile—NOT!

Your Grandfather’s Oldsmobile—NOT! – BLOG@UBIQUITY. The self-driving car is coming to our streets. Might not be as soon as some predicted, but it will come in incremental steps. Technology has this feature: You dream about radical changes and then they appear slowly, one step at the time, and when you look back you realise that […]

Thinking in Minimum Spanning Trees

A Minimum Spanning Tree is a subgraph of a graph that is a TREE and connects all vertices together such the total cost of connection is minimal. Because of that, they are interesting objects. First, TREES, What are they? For any two given nodes have only one path between them and all nodes have one path […]

Why landing the SpaceX Falcon 9 rocket is a DUMB decision?

Throw a pencil from a twenty story building and every kid knows that the probability of it landing on its head is close to zero. So, why is the SpaceX trying to do it? As an engineer, I see this is one of those cases of failure by design. The rocket almost made it and […]

Switching to Colemak – My ColemaP

During 2014 I decided to switch to Colemak keyboard layout. I just want now to give a brief overview of the process, and where I am right now. Here are a few pointers if you want to try it yourself. Switching keyboard layouts is not easy. Many people give up and stick to qwerty forever. […]

10Web – Podcast Redux

Dizem que a produção de podcasts está morta, que não há produtores independentes. Que as rádios enchem as playlists do iTunes de forma que o podcast independente não tem visibilidade nenhuma. Talvez seja verdade, ou tudo não passa de uma conspiração para fazer o prazer da rádio. Tudo em torno de um conceito tão simples […]

The Secret Of My Endurance

I still get letters in the mail, mostly from cracked-up men in tiny rooms with factory jobs or no jobs who are living with whores or no woman at all, no hope, just booze and madness. I get most of their letters on lined paper written with an unsharpened pencil or in ink in tiny […]

Restoration of the Brother XL1010 Typewriter

My latest restoration project was the first time I had a Made in Portugal typewriter in my ‘shop’. This machine is a Brother XL1010 made in Algueirão, Mem Martins, a suburb of Lisbon where the Messa company had its factory. In the ’70s, Messa was building typewriters for several different brands and while the Japanese […]

Why I’ve put typewriters into my writing routine

There was a time when the typewriter ruled the earth and the dinosaurs were roaming into oblivion. But that was a time when the typewriter liberated writing. It was the easiest and most direct way to put down on paper a structured text that could be given to anyone without being ashamed of the handwriting. […]

Sexo, mentiras e Blogger

O Blogger anunciou que não quer sexo. Nada de sexo, nudez, ou algo que possa minimamente assemelhar-se a tal. Ponto final, finito. A verdade é que o Blogger há muito que tem feito por se tornar irrelevante e esta é mais uma pequena acha para uma fogueira que já não tem grande chama. – Se […]

Under the Skin

I finally managed to see Under the Skin. This is a science fiction movie so out of the ordinary that someone should create a category just for it. Scarlett Johansson makes a big acting statement about not being just another pretty face in a great body. In Under the Skin, Scarlett Johansson produces an excellent […]

And The Oscar Goes To

Ok, this is not a review neither it is a pre-Oscar selection of films… It is just a list and a short one. So Oscar, here we go: Boyhood – What a great story and a technically difficult one to do. A coming of age movie that runs almost three hours (166 min) long without feeling repetitive […]

Surrounded by sound: how 3D audio hacks your brain – Binaural audio explained

Surrounded by sound: how 3D audio hacks your brain. The Verge wrote a great story how binaural audio is recorded and how it is perceived by our brains. A great story on how the brain responds to the 3D sound around us. It is just an eight-minute read. Binaural audio recordings try to reproduce the […]

Para quando o Xadrez a ser ensinado em Portugal?

Fig: App para visualizar FEN e território em Xadrez Em Espanha, o governo decidiu introduzir o Xadrez no currículo escolar. A decisão não é nada parva, mas sabendo que é um desporto barato e que ajuda no desenvolvimento das crianças, resta saber porque é que não pensa em Portugal em algo semelhante? Os custos seriam […]

Quanto vale uma máquina de escrever manual?

Com o advento dos computadores as máquinas de escrever quase desapareceram dos escritórios e secretárias, para passarem a ser apenas um objecto decorativo que apenas encontram as montras de lojas para se mostrar. É verdade que as máquinas de escrever têm um look retro e há antiquários que as querem vender como jóias de um […]

Tip: Remap the Caps Lock key as a Backspace

For some time now I’ve been using my Caps Lock key as Ctrl (probably the Caps Lock key is the most useless key in any keyboard) but after switching to the Colemak layout (part 2) I’ve come to the conclusion that the Caps Lock can be very useful if configured as a Backspace key. Having […]