open-discussion
open-discussion > RE: AAAS: Your Paper MUST include Data and Code
Mar 10, 2011 08:03 PM | Pierre Bellec
RE: AAAS: Your Paper MUST include Data and Code
Well I'd say that a lot of people will agree on the principles of
reproducible research and will clearly see the benefits, but I am
surprised no one has mentioned yet how challenging this is in
practice for neuroimaging. First there are huge issues with
anonymization, especially for clinical data. Processing a dataset
is one thing, releasing it publicly is another (faces in T1 scans
have to be blurred for example). Then you need to host securely
tons of datasets online. In the same vein, coding an in-house
algorithm is one thing, releasing it publicly is again completely
different (you need to document !). For new algorithms, the
production environment can be very hard to reproduce. Moreover, the
analysis itself can be computationally challenging (I use
supercomputers all the time, this is not used by the vast majority
of the neuroimaging community). Not to mention that a lot of
research group do not fully automatize their data processing flow.
My point is that it is not enough to say "let's go
reproducible/public/open source/....". We also need an
infrastructure to do so. I bet that in the next couple of years we
will have websites that allow to share datasets publicly, and
request with only a couple clicks for processing in
supercomputers with well tested and maintained analysis pipeline.
There are many current efforts in that direction (e.g. http://www.cbrain.mcgill.ca/). But at this stage this is science fiction as far as I know.
Threaded View
Title | Author | Date |
---|---|---|
Luis Ibanez | Mar 10, 2011 | |
hongtu zhu | Mar 13, 2011 | |
Luis Ibanez | Mar 13, 2011 | |
Matthew Brett | Mar 13, 2011 | |
Isaiah Norton | Mar 13, 2011 | |
Torsten Rohlfing | Mar 10, 2011 | |
Luis Ibanez | Mar 11, 2011 | |
Daniel Kimberg | Mar 10, 2011 | |
Cinly Ooi | Mar 10, 2011 | |
Torsten Rohlfing | Mar 10, 2011 | |
Cinly Ooi | Mar 10, 2011 | |
Torsten Rohlfing | Mar 10, 2011 | |
Cinly Ooi | Mar 10, 2011 | |
Torsten Rohlfing | Mar 10, 2011 | |
Cinly Ooi | Mar 10, 2011 | |
Matthew Brett | Mar 10, 2011 | |
Pierre Bellec | Mar 10, 2011 | |
Luis Ibanez | Mar 11, 2011 | |
Matthew Brett | Mar 10, 2011 | |
Cinly Ooi | Mar 10, 2011 | |
Cinly Ooi | Mar 10, 2011 | |
Torsten Rohlfing | Mar 10, 2011 | |
Daniel Kimberg | Mar 10, 2011 | |
Cinly Ooi | Mar 10, 2011 | |