It is always a turn-on when a doctor quotes Karl Popper. Our first lecturer today paraphrased Popper’s stress on the importance of reproducibility in research: science does not rest on it’s infallibility, but on it’s reproducibility. The project of medical journals, he offered, is to provide a forum for rigororoulsy reviewing science, and making sure it is reproducible. To take a step back, our first question was “what is the point of medical journals?” The follow up question was naturally, “and why not just cut out the middle-man, and let basic researchers communicate directly with the public?” Numerous scientists take the latter question seriously, and through online databases, provide forum for rapid dissemination of scientific work, prior to the laborious peer-reviewed paper journal process. One of the prominent groups that is advocating increased access to scientific findings is a website Panton Principles, named after a UK watering hole (seen above). Their argument is given below:
- Science is based on building on, reusing and openly criticising the published body of scientific knowledge.
- For science to effectively function, and for society to reap the full benefits from scientific endeavours, it is crucial that science data be made open.
- By open data in science we mean that it is freely available on the public internet permitting any user to download, copy, analyse, re-process, pass them to software or use them for any other purpose without financial, legal, or technical barriers other than those inseparable from gaining access to the internet itself. To this end data related to published science should be explicitly placed in the public domain. (http://pantonprinciples.org/)
Note that these priniciples do not distinguish between scientific specialty – presumably, physics is on the same footing as geology, medicine, or astronomy. There are a number of issues with this:
1) What are the stakes? The stakes of research in the physical sciences (and mathematics) are different from those in medicine. If an online mathematical journal publishing a spurious proof prematurely, this is a small price to pay for this reasoning being out there. In contrast, in medicine such a mis-step in information could have downstream effects for other researchers, clinicians, and ultimately patients.
2) What is the quality of the review board? In certain online scientific databases, journals are reviewed via large editorial boards. In contrast, large medical journals are reviewed via editorial boards and outsource to academic specialists. If there is a hot paper in cardiology, the editor will collaborate with an independent expert cardiologist in the field. The latter model may take longer but ultimately tailors reviews to speciality with greater precision.
3) Who are you accountable to? While laborious, the peer-review process offers a high standard of scientific accountabilty that is not yet built into less traditional forms of publishing. What if you pre-publish online, and then subsequently make radical changes and get your publication submitted elsewhere. Do you have an obligation to re-post your new research? If you do not, are there mechanisms in place to find this out?
4) Who decides what is the “best information” for the public? One of the advantages of open-source forum is the democratic ideal that the consumers of information will determine what constitutes important science. As someone who perceives a bias toward invasive, sub-specialized care in academic medicine, this reasoning appeals to me. This is known as subject bias – to preferentially publish in certain areas at the exclusion of others. One rebuttal to this is: well, the duty of a journal is to accurately represent what people are choosing to investigate, as well as what is possible to investigate. In some ways, investigating the finer points of glucose metabolism is easier to capture than accurately testing a large-scale societal strategy for diabetes.
Will the open-source activism that is taking hold in the physical sciences take hold in the medical arena? Perhaps, but the stakes are invariably higher.
