indi > RE: Distribution of Test Labels
Sep 26, 2011  04:09 PM | Paolo Avesani
RE: Distribution of Test Labels
I don't believe to setup a service for subsequent submissions would be a good idea. There is the risk to orient a lot of effort just to overfit the test set without achieving any additional insight both on ADHD or computational methods. Last but not least I wouldn't neglect the cost to deliver and maintain an effective service of submission. The scenario could become even awful if we consider that the original data might be extended or fixed, both those for training and those for test.

I would recommend to collect a new test set for a second round of the competition since I consider your effort to arrange the ADHD dataset really valuable.

Threaded View

TitleAuthorDate
Paolo Avesani Sep 15, 2011
John Muschelli Sep 28, 2011
RE: Distribution of Test Labels
Paolo Avesani Sep 26, 2011
Satrajit Ghosh Sep 27, 2011
Maarten Mennes Sep 27, 2011
Arno Klein Sep 27, 2011
Huiguang He Sep 17, 2011
Maarten Mennes Sep 26, 2011