NIH | National Cancer Institute | NCI Wiki  

Date

Attendees

NameAttended
Jayashree Kalpathy-CramerYes
Ulli WagnerYes
Carolyn KlingerYes
Benjamin BearceYes


Currently supported challenges

Name of ChallengeOrganization / MeetingMedici instance
used

Release
Training data

Release Validation dataRelease
Test data
Number of
Participants
Closing DateWill the challenge remain open?Comments

SPIE-AAPM-NCI DAIR Digital Breast Tomosynthesis Lesion Detection Challenge (DBTex)


http://spie-aapm-nci-dair.westus2.cloudapp.azure.com/competitions/4

 

1/4/2021


1/15/2021

132 registrants

9 submissions

1/25/2021
Challenge completed. The validation phase remains open.
Deep-learning for inverse problems: sparse-view X-ray Computed Tomography image reconstruction

Emil Sidky (UChicago)

Here's a link for the Challenge description/rules/timeline:

https://www.dropbox.com/s/ciqqbal4xlxcn8x/DL-sparse-view-CT-challenge.docx?dl=0

Challenge Location: http://dl-sparse-view-ct-challenge.eastus.cloudapp.azure.com/

Related to AAPM Annual meeting in July

3/17/2021March 31, 2021May 17, 2021123 registrants5/31/2021

2021/04/01

In validation phase

Ben & Emil are testing

Data are on an FTP server.

Ben set up an Azure container to download the data for two participants.


Tasks / Deliverables


TaskDue DateDeliverableStatus

Support of at least new two challenges

  • MICCAI 2020
  • SPIE-AAPM-NCI DAIR
  • DL Sparse View CT Challenge
8/30/2021

Reopen three previously executed challenges

  • process the results of new submissions
  • update the leaderboards
  • inform participants of their results
8/30/2021
  • Keyvan is going to contact M. M. (Duke) re second breast tomosynthesis challenge
  • BreastPathQ challenge challenge (paper was just published)
  • Contact challenge organizers and/or professional organizations for permission to re-open the challenges
  • need to make decisions on how to best handle the challenges
  • find out if the datasets are still available and can be continued to be shared
  • Wagner, Ulrike (NIH/NCI) [C] schedule meeting to discuss this


Ben to investigate how to reopen the challenges e.g. by adding a new phase

Discuss with Jayashree which challenges to reopen, reach out to MICCAI organization group to ask if they would be ok to reopen.

Verify that users can create accounts

Are the images still available?

Start with one challenge.


Maintain and update the website8/30/2021


  • Capturing and providing metrics on the use of the MedICI website
8/30/2021
Investigate Google analytics plug-in - DONE (2021/04/01)
  • Capturing and providing metrics on the challenges
8/30/2021


Investigate the use of MedICI for federated learning challenges

 

Report

Investigate the integration of MedICI with Kheops

 

Report

Presentation: NCI Imaging Informatics Webinar

The recordings are towards the bottom of the page.

URL: https://kheops.online/

Draft: https://docs.google.com/document/d/1c20ny4UNWw4BTXhdFPmc3o0YG00toOndbklXhc40Rqc/edit


Support the deployment of MedICI in NCI cloud environments8/30/2021

App scan found vulnerabilities, Ben fixed them, app needs to be tested with test cases that are provided by Codalab, Ben needs to familiarize himself with the test suite. Codalab needs to be app scanned again.

Codalab can connect to various storage places: Azure, AWS, GCP

2021/04/15 - NCI is hardening security which makes deployment much harder. NCI VMs are not allowed to talk to cloud environments. Kevin is investigating workarounds. The goal is to run an app scan. 

Keyvan suggested trying a Codalab deployment on Google cloud outside of the NCI network. Keyvan will investigate.



Discussion items


TimeItemWhoNotes

Notes 
AAPM part of MIDRC is planning to use Medici for challenges

Action Items


Upcoming challenges

BMMR2: Breast Multiparametric MRI for prediction of NAC Response (Organizer David Newitt, UCSF)

  • Information from TCIA team: as of  UCSF had not sent the majority of the data to TCIA for curation. Curation will take a few weeks
  • What does this mean for the timeline of this challenge?
  • Last update from David Newitt received on 10/06/2020
  •  - problems with data transfer to TCIA, data transfer now completed, TCIA is curating, David Newitt has been given access to the Medici instance
  • COVID challenge (Randy Gollub, Jayashree Kalpathy-Cramer)

Monthly status reports
add Monday NCI cloud email to the monthly status report

Contract / invoice status / SOW

July 2020 invoice received, can now close out the contract year ending 8/30/2020.

September to November 2020 invoice has been received



PIV card / GFE laptop / VPN

VPN access


Paper
The draft will be submitted by September 15, 2020. - Not received

Videos
  • Hold the work on the video for now

Strategy meeting
  • review paper
  • open challenges back up (contract / funding)
  • website

Action items