NIH | National Cancer Institute | NCI Wiki  

Error rendering macro 'rw-search'

null

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Activities completed this month

  • MIDRC is up and running and challenge details are being ironed out: https://midrc-medici-competitions.eastus.cloudapp.azure.com/
    • Training Phase underway and participants are submitting the provided template to practice submitting docker images.
  • CodaLab (Open Source Team):
    • I drafted an SOW and they have accepted. Our focus is going to be to have me work on Codabench which is the next generation of Codalab.
    • I've launched a local version of Codabench and have uploaded some of our old competitions from MedICI (DL-Sparse). It uploads but it looks like submissions fail. Investigating nowWrote some notes for them regarding various demos we get from Tyler Thomas, a contract worker for CodaLab.
  • Federated learning challenge:
    • Temp site is up to furnish challenge data: https://medici-codalab-main.eastus.cloudapp.azure.com/competitions/24
    • Their security scans said python2 and python3 have vulnerabilities. They are asking me to not use these libraries or delete the files from these libraries:
      • ACR requested the scan of MedICI docker containers for use in their system.
    • New Infrastructure Diagram:
    • Image preview
  • True-CT Challenge
    • Challenge ended this month and organizer have chosen to keep the leaderboard private. 
  • DL-SPARSE Challenge
  • SIRPRISE Challenge
    • Challenge ended this month as well but some participants needed to submit after the deadline as they kept getting failures for malformed submissions. 
Planned for next month
  • MIDRC Challenge 0
    • UPDATE (3/31/2022): Infrastructure is built and now we are editing the template challenge to be the real challenge. 
    • UPDATE (4/29/2022): Training phase is underway and participants are testing submissionsEnds next month. We will want to review what happened and talk about what we want to change for challenge1.
  • Federated Learning Challenge: 
    • Still need VPN access to environment.
    • Kendall Schmidt (from ACR) and Holger Roth (from NVIDIA) are creating a bash script that kicks off a participant container. 
    • I will be in charge of orchestrating the start of that script from the MedICI website.
  • CodaLab (Open Source Team): 
    • I need to draft a SOW to work with the team and become a contract worker with them
    • The team wants me to review documentation they have from the original developers of Codabench regarding sample challenges and new functionality and general operation of the site as a whole. 
    • They want to deploy a dev VM for me with Codabench launched so I can test many competitions and figure out the state of the platform and codebase. Launch local version of CodaBench and see if we can get some old challenges to run.
Paused
  1. Continue getting CodaLab running on NCI's network and VMs:
    1. UPDATE (01_31_2022): May have a work around with a storage service called MINIO.
    2. UPDATE (04_29_2022): The CodaLab (Open Source Team) has updates to the python2 → python3 update branch on github and I think it will work on NCI's network. However I think it is better to spend time working on CodaBench to get the new version working so that we aren't constantly behind when serving challenges and integrating with new software. It's taking lots of time to maintain older challenges while trying to work on new code. 

...