NIH | National Cancer Institute | NCI Wiki  

Error rendering macro 'rw-search'

null

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 11 Current »

Date

Attendees

NameAttended
Jayashree Kalpathy-CramerYes
Ulli WagnerYes
Carolyn KlingerNo
Benjamin BearceYes


Currently supported challenges

Name of ChallengeOrganization / MeetingMedici instance
used

Release
Training data

Release Validation dataRelease
Test data		Number of
Participants		Closing DateWill the challenge remain open?Comments











Previously supported challenges that remain open

Name of ChallengeOrganization / MeetingMedici instance
used

Release
Training data

Release Validation dataRelease
Test data		Number of
Participants		Closing DateWill the challenge remain open?Comments










Tasks / Deliverables


TaskDue DateDeliverableStatus

Supporting at least three challenges including one federated learning challenge

8/30/2022


Support organizers and participants (help desk, FAQ, training, presentations)

8/30/2022




Maintain and update the website8/30/2022


Capturing and providing metrics on the use of the MedICI website

8/30/2022


Capturing and providing metrics on the challenges

8/30/2022


Support at least three previously executed challenges

8/30/2022


MedICI on the NCI Cloud Two (GCP) and Firecloud

8/30/2022

Task was suspended per discussion on  


Operations and Maintenance

8/30/2022







Discussion items


TimeItemWhoNotes

Notes 


Action items






Unknown User (bearceba)  - investigate options on how to keep challenges open, add phase or copy challenge, avoid having users add to the previous submissions

SPIE-AAPM-NCI DAIR Digital Breast Tomosynthesis Lesion Detection Challenge (DBTex) - Phase 1 - Unknown User (bearceba) verify with submitters that decision of phase 2 applies to phase 1

DAIR Digital Breast Tomosynthesis Cancer Detection Challenge - Phase 2 (DBTex2) - keep open

BMMR2 - close on as previously planned. David Newitt responded.

MICCAI 2020 - has already an open test phase

ISBI 2018 - has already an open test phase


Upcoming challenges


Responses to question about keeping challenges open

BMMR2 - do not keep open (David Newitt, Thu 10/28/2021 7:10 PM) - link to the challenge data will be de-activated on 12/1/2021

 - keep open (Emil Sidky, Thu 10/28/2021 11:42 PM) 

SPIE-AAPM-NCI-DAIR & SPIE-AAPM-NCI-DAIR Phase 2  - TBD - (Nick Konz, Wed 11/24/2021 11:36 AM) "Maciej and I discussed this and an idea that we’ve been floating is to have some sort of ongoing validation phase, that would allow anyone to get validation results on their model. We would also want to have a periodic, occasional test phase for people to get test results."


Information sharing


Monthly status reports
due on the 10th day of the following month

Contract / invoice status / SOW
  • the last invoice was for June 2021
  • need invoices at least up to 08/2021 to close out the contract year that ended  
  • need invoices for the current contract year
  • Ben sent reminder emails to Peter Hickey on 10/25/2021. Resent it today.

Paper
The draft will be submitted by September 15, 2020. - Not received

Videos
    • Hold the work on the video for now



Federated learning challenge - proposal for MICCAI, ACR confirmed that the data can be used

Wagner, Ulrike (NIH/NCI) [C] Change SOW, take cloud out, put federated learning modifications for Codalab in, send to Medici for review





Action items


  • No labels