Date

Attendees

NameAttended
Jayashree Kalpathy-CramerYes
Ulli WagnerYes
Carolyn KlingerYes
Benjamin BearceYes


Currently supported challenges

Name of ChallengeOrganization / MeetingMedici instance
used

Release
Training data

Release Validation dataRelease
Test data
Number of
Participants
Closing DateWill the challenge remain open?Comments

SPIE-AAPM-NCI DAIR Digital Breast Tomosynthesis Lesion Detection Challenge (DBTex)


http://spie-aapm-nci-dair.westus2.cloudapp.azure.com/competitions/4


Phase 2

https://spie-aapm-nci-dair.westus2.cloudapp.azure.com/competitions/6

 

1/4/2021


1/15/2021

132 registrants

9 submissions

1/25/2021
Challenge completed. The validation phase remains open.
Deep-learning for inverse problems: sparse-view X-ray Computed Tomography image reconstruction

Emil Sidky (UChicago)

Here's a link for the Challenge description/rules/timeline:

https://www.dropbox.com/s/ciqqbal4xlxcn8x/DL-sparse-view-CT-challenge.docx?dl=0

Challenge Location: http://dl-sparse-view-ct-challenge.eastus.cloudapp.azure.com/

Related to AAPM Annual meeting in July

3/17/2021March 31, 2021May 17, 2021123 registrants5/31/2021

2021/04/01

In validation phase

Ben & Emil are testing

Data are on an FTP server.

Ben set up an Azure container to download the data for two participants.


Tasks / Deliverables


TaskDue DateDeliverableStatus

Support of at least new two challenges

8/30/2021

Reopen three previously executed challenges

  • process the results of new submissions
  • update the leaderboards
  • inform participants of their results
8/30/2021



Maintain and update the website8/30/2021


  • Capturing and providing metrics on the use of the MedICI website
8/30/2021

Investigate Google analytics plug-in - DONE (2021/04/01)


391 page views, 107 users over the last 12 months


  • Capturing and providing metrics on the challenges
8/30/2021


Investigate the use of MedICI for federated learning challenges

 

Report

https://docs.google.com/document/d/1v7Mz-diz8wSXzpdrGOGXwaDnZAOZ2t879frgTvzyt24/edit#heading=h.tqyuzeebfeoq

  • need to understand what is meant by "federated learning"
  • review report
  • have a discussion with Keyvan
  • determine if MedICI is suited for support of federated challenges
  • if yes, what needs to be done to make it suitable
  • find time for discussion during the week of November 15

Investigate the integration of MedICI with Kheops

 

Report

Presentation: NCI Imaging Informatics Webinar

The recordings are towards the bottom of the page.

URL: https://kheops.online/

Draft: https://docs.google.com/document/d/1c20ny4UNWw4BTXhdFPmc3o0YG00toOndbklXhc40Rqc/edit

The report was finalized on  


Support the deployment of MedICI in NCI cloud environments8/30/2021

App scan found vulnerabilities, Ben fixed them, app needs to be tested with test cases that are provided by Codalab, Ben needs to familiarize himself with the test suite. Codalab needs to be app scanned again.

Codalab can connect to various storage places: Azure, AWS, GCP

2021/04/15 - NCI is hardening security which makes deployment much harder. NCI VMs are not allowed to talk to cloud environments. Kevin is investigating workarounds. The goal is to run an app scan. 

Keyvan suggested trying a Codalab deployment on Google cloud outside of the NCI network. Keyvan will investigate.



Discussion items


TimeItemWhoNotes

Notes 


Action items




Upcoming challenges
  • COVID challenge (Randy Gollub, Jayashree Kalpathy-Cramer)

Information sharing


Monthly status reports
add Monday NCI cloud email to the monthly status report

NCI MedICI installation
CodaLab on AWS, Codalab's older version is still working, and some developers check-in code. The newer version (Python 3) had the last commit in August 2020. Deploying on a different cloud platform (AWS) and within the NCI environment is difficult. 

Contract / invoice status / SOW
  • Authorization to Proceed was issued, covers the month of September
  • Contract mod will follow
  • Invoice ending 8/30/2020 - in progress
  • Invoice 8/31/2020
  • Cost proposal for the new contract year: FNLCR will request a modification to the cost proposal -  Done.



PIV card / GFE laptop / VPN

VPN access


Paper
The draft will be submitted by September 15, 2020. - Not received

Videos
  • Hold the work on the video for now

Strategy meeting
  • review paper
  • open challenges back up (contract / funding)
  • website

Action items