NIH | National Cancer Institute | NCI Wiki  

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

1) Helped Greg Sharp and Mark Gooding update AAPM RT-MAC challenge data. There is now new test data.2) Setup MICCAI 2019 FTP server for data downloadLoaded validation data to ftp server for participants to access.

2) Fixed docker for evaluation script which was using an old version of sklearn for python. This was necessary to access the Balanced Accuracy Score method of sklearn. 

3) Test ran docker submission from Tahsin to simulate a participant. NIH has done the same thing and we got comparable results. NIH should be all set to run these dockers and MGH will be on standby if more resources are necessary.


Planned for next month

1)

Get Docker submissions implemented for MICCAI challenge.

2) Aid in RT-MAC live challenge phase

Setup test data on ftp server

2) Learn docker integrations of caMic and ePAD

Comments
We need to tell NIH to reserve two VMs instead of one to run participants submissions. Submissions may take days (2-3).
Comments
MeetingDate
Bi-weekly Meeting #1 (canceled)

11 Jul  

Bi-weekly Meeting #2

25 Jul  

Milestones

DescriptionDate
FTP server created
sklearn update in worker docker8/15/2019
Identified main evaluation metrics for participants8/12
7/10
/2019

Task

DescriptionResolutionStatusCreation DateClose Date
Some confusion on when testing phase submissions are allowedWorking with Tahsin and Spiridon to get clarityI forsee participants having download issues.I will adjust the download notes based on forum discussion among participants having an issueIn Progress78/1131/20197/15/2019--
Traversing notes Ask Jayshree about caMicroscope/EPad/TCIA integrationIn progressIn progress8/31/2019

Risks

DescriptionMitigationRankStatusCreation DateRealizationClose Date
Long evaluation time for participant submissions
NIH MICCAI site may not go liveMGH MICCAI Site or Sendgrid for email
Multiple VMs on NIH's side as well as MGH resources at the ready.1
In NIH's hands7/11
Pending8/31/2019
internal email server not working with website
----