NIH | National Cancer Institute | NCI Wiki  

Error rendering macro 'rw-search'

null

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Activities completed this month

  • MIDRC is up and running and challenge details are being ironed out: https://midrc-medici-competitions.eastus.cloudapp.azure.com/
    • Training Phase underway and participants are submitting the provided template to practice submitting docker images.
  • CodaLab (Open Source Team):
    • Wrote some notes for them regarding various demos we get from Tyler Thomas, a contract worker for CodaLab.
  • Federated learning challenge:
  • True-CT Challenge
    • There were some upload data issues where participants were getting permission denied when trying to sign into their sftp file shares.
    • Otherwise things are good and we have pushed the phase to submit back to May 31st.
  • DL-SPARSE Challenge
    • We are in the validation phase and data for that phase has been updated:
      • ground truth
      •  test set has been added to sftp server
  • SIRPRISE Challenge
    • There may be an email bug so working with Diane to iron that out. UPDATE: I believe we fixed this. Sometimes though CodaLab is blocked and emails are sent to spam. Not sure how to deal with that yet.
    • Challenge is over on the 23rd due to supply issues of some chemicals. 
Planned for next month
  • MIDRC Challenge 0 which will feature docker submissions as well as the Image Comparator app and a jupyter notebook for annotator analysis. - Still waiting on credits for Azure use.
    • UPDATE (3/31/2022): Infrastructure is built and now we are editing the template challenge to be the real challenge. 
    • UPDATE (4/29/2022): Training phase is underway and participants are testing submissions.
  • Federated Learning Challenge: 
    • Still need VPN access to environment.
    • Kendall Schmidt (from ACR) and Holger Roth (from NVIDIA) are creating a bash script that kicks off a participant container. 
    • I will be in charge of orchestrating the start of that script from the MedICI website.
  • CodaLab (Open Source Team): 
    • I need to draft a SOW to work with the team and become a contract worker with them
    • Launch local version of CodaBench and see if we can get some old challenges to runAdding more functionality to the highlights page for the addition of dynamic news.
Paused
  1. Continue getting CodaLab running on NCI's network and VMs:
    Issues:
  2. Credentials for AWS bucket not active and we cannot talk to the bucket. Need to reach out to Tony Bigham (tony.bigham@nih.gov) to get those refreshed. 
  3. On my local machine I deployed the updated CodaLab code and tried connecting to my own S3 bucket instance. I noticed that there is a javascript error making the request to the bucket. I need to setup up a similar but more simple setup to figure out how to upload data to s3 via javascript http requests so that I can trouble shoot the error on NCI's system and or mine. If we could use Azure, this might be resolved.
    1. UPDATE (01_31_2022): May have a work around with a storage service called MINIO.
    2. UPDATE (0304_3129_2022): The CodaLab (Open Source Team) has updates to the python2 → python3 update branch on github and I think it will work on NCI's network. However I think it is better to spend time working on CodaBench to get the new version working so that we aren't constantly behind when serving challenges and integrating with new software. It's taking lots of time to maintain older challenges while trying to work on new code. 

MeetingDate
Bi-weekly Meeting #1

03 Feb  

Bi-weekly Meeting #2

 


Milestones

DescriptionDate
Fed Learning Challenge for MICCAI underway

 

MIDRC Challenge Underway (might get pushed to May 5th, but it's live)

Python3 version of CodaLab may be ready for NCI's environment.

22 Mar  



Task in Progress

Description
FL Learning Challenge deploy
Working out GPU VM worker for MIDRCLaunching DL-Sparse Challenge from Emil soon. This is version 2.

Risks

Description

Mitigation

Rank

Status

Creation Date

Realization

Close Date

Security issues with MedICI at ACR could be a potential issue restricting the use and operation of this challenge

delete or remove these libraries and hope that doesn't break anything fundamental or crucial to MedICI

1

ongoing




Having trouble activating certain azure functionality in ACR's environment. I can't connect to the internet when on their VPN and certain sign in work flows require me to sign in via a browser and so I can't hook MedICI up to it's normal resources yet.