NIH | National Cancer Institute | NCI Wiki  

Error rendering macro 'rw-search'

null

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

Version 1 Next »

Date

Attendees

NameAttended
Jayashree Kalpathy-Cramer
Ulli WagnerYes
Carolyn KlingerYes
Benjamin BearceYes


Currently supported challenges

Name of ChallengeOrganization / MeetingMedici instance
used

Release
Training data

Release Validation dataRelease
Test data
Number of
Participants
Closing DateWill the challenge remain open?Comments

SPIE-AAPM-NCI DAIR Digital Breast Tomosynthesis Lesion Detection Challenge (DBTex)


http://spie-aapm-nci-dair.westus2.cloudapp.azure.com/competitions/4


Phase 2

https://spie-aapm-nci-dair.westus2.cloudapp.azure.com/competitions/6

 

1/4/2021


1/15/2021

132 registrants

9 submissions

1/25/2021
Challenge completed. The validation phase remains open.
Deep-learning for inverse problems: sparse-view X-ray Computed Tomography image reconstruction

Emil Sidky (UChicago)

Here's a link for the Challenge description/rules/timeline:

https://www.dropbox.com/s/ciqqbal4xlxcn8x/DL-sparse-view-CT-challenge.docx?dl=0

Challenge Location: http://dl-sparse-view-ct-challenge.eastus.cloudapp.azure.com/

Related to AAPM Annual meeting in July

3/17/2021March 31, 2021May 17, 2021123 registrants5/31/2021

2021/04/01

In validation phase

Ben & Emil are testing

Data are on an FTP server.

Ben set up an Azure container to download the data for two participants.


Tasks / Deliverables


TaskDue DateDeliverableStatus

Support of at least new two challenges

  • MICCAI 2020
  • SPIE-AAPM-NCI DAIR
  • DL Sparse View CT Challenge
8/30/2021

Reopen three previously executed challenges

  • process the results of new submissions
  • update the leaderboards
  • inform participants of their results
8/30/2021
  • Keyvan is going to contact M. M. (Duke) re second breast tomosynthesis challenge
  • BreastPathQ challenge (paper was just published)
  • Contact challenge organizers and/or professional organizations for permission to re-open the challenges
  • need to make decisions on how to best handle the challenges
  • find out if the datasets are still available and can be continued to be shared
  • Wagner, Ulrike (NIH/NCI) [C] schedule meeting to discuss this


Ben to investigate how to reopen the challenges e.g. by adding a new phase

Discuss with Jayashree which challenges to reopen, reach out to MICCAI organization group to ask if they would be ok to reopen.

Verify that users can create accounts

Are the images still available?

Start with one challenge.


Maintain and update the website8/30/2021


  • Capturing and providing metrics on the use of the MedICI website
8/30/2021
Investigate Google analytics plug-in - DONE (2021/04/01)
  • Capturing and providing metrics on the challenges
8/30/2021


Investigate the use of MedICI for federated learning challenges

 

Report

Investigate the integration of MedICI with Kheops

 

Report

Presentation: NCI Imaging Informatics Webinar

The recordings are towards the bottom of the page.

URL: https://kheops.online/

Draft: https://docs.google.com/document/d/1c20ny4UNWw4BTXhdFPmc3o0YG00toOndbklXhc40Rqc/edit

The report was finalized on  


Support the deployment of MedICI in NCI cloud environments8/30/2021

App scan found vulnerabilities, Ben fixed them, app needs to be tested with test cases that are provided by Codalab, Ben needs to familiarize himself with the test suite. Codalab needs to be app scanned again.

Codalab can connect to various storage places: Azure, AWS, GCP

2021/04/15 - NCI is hardening security which makes deployment much harder. NCI VMs are not allowed to talk to cloud environments. Kevin is investigating workarounds. The goal is to run an app scan. 

Keyvan suggested trying a Codalab deployment on Google cloud outside of the NCI network. Keyvan will investigate.



Discussion items


TimeItemWhoNotes

Notes 


Action items




Upcoming challenges
  • COVID challenge (Randy Gollub, Jayashree Kalpathy-Cramer)

Information sharing


Monthly status reports
add Monday NCI cloud email to the monthly status report

Contract / invoice status / SOW
  • Invoices for cloud cost are being worked on at FNLCR - meeting this afternoon, Ulli will not attend
  • Invoice up to 6/30/2021 has arrived at FNLCR



PIV card / GFE laptop / VPN

VPN access


Paper
The draft will be submitted by September 15, 2020. - Not received

Videos
  • Hold the work on the video for now

Strategy meeting
  • review paper
  • open challenges back up (contract / funding)
  • website

Action items


  • No labels