Page History

...

Kaggle is a very popular platform for data science competitions. It is a commercial platform used by companies to pose problems for monetary rewards, jobs and knowledge advancement. There are public and private leaderboards with the test data also being withheld from the participant. Typical hosting costs are reported to be $15,000-20,000 plus additional costs for prizes. However, Kaggle does have a free hosting option to organize challenges for educational purposes. CKK: Reviewer comment: "Questions: How are educational challenges defined? Would NCI-run challenges fall under this category? What limitations do educational challenges vs. paid challenge hosting have?"This option is primarily meant to be used by instructors as part of the class curriculum. Kaggle does not provide any support for organizers of Kaggle In Class. There is a 100GB limit on file size. There also appears to be very simple options for scoring. Almost all challenges hosted here appear to be prediction type challenges where results can be submitted as a csv file and the "truth" is also a csv file. It does not appear that imaging-based challenges (such as segmentation challenges) would lend themselves to being hosted on Kaggle In Class without significant effort.

...

• Mean F Score
• Mean Consequential Error
• Mean Average Precision@nPrecision
• Multi Class Log Loss
• Hamming Loss
• Mean Utility

...