NIH | National Cancer Institute | NCI Wiki  

  • Created by Unknown User (bearceba), last modified on Apr 01, 2021
Activities completed this month
  1. Finished securing and setting up scoring program for DL Sparse view challenge: http://dl-sparse-view-ct-challenge.eastus.cloudapp.azure.com/
  2. Created sftp server for data hosting for DL Sparse view challenge: http://dl-sparse-view-ct-challenge.eastus.cloudapp.azure.com/
  3. I have a ported version of codalab to python3 working with custom changes to python and jQuery to update those libraries.
  4. Added Google Analytics to medici-challenges site:


    I used multiple computers to generate the data you see. Turned out to be as easy as making an account and pasting this code in:
    
  <!-- Global site tag (gtag.js) - Google Analytics -->
  <script async src="https://www.googletagmanager.com/gtag/js?id=G-E6QEGBLBZQ"></script>
  <script>
    window.dataLayer = window.dataLayer || [];
    function gtag(){dataLayer.push(arguments);}
    gtag('js', new Date());

    gtag('config', 'G-E6QEGBLBZQ');
  </script>

    Added Google Analytics to medici-challenges site:
    5. Opened these Challenges:
    1. MICCAI 2020 (https://miccai.westus2.cloudapp.azure.com/) - submissions working
    2. ISBI 2018 (http://isbichallenges.cloudapp.net/competitions/15#participate) - submissions working
    3. RT-MAC (http://aapmchallenges.cloudapp.net/competitions/34) - submissions working
    4. SPIE AAPM (http://spie-aapm-nci-dair.westus2.cloudapp.azure.com/competitions/4#participate-submit_results) - submissions working, but we need to change open validation phase to open ended phase after test. Will require a code update from main codalab branch.
    5. AAPM Grand Challenge (http://aapmchallenges.cloudapp.net/competitions/35#results) - submissions not working and old data seems like it's missing
Planned for next month
  1. Continue opening older challenges listed on https://medici-challenges.org so that people can still make submissions.
  2. Investigate Federated Learning Challenges (https://wiki.nci.nih.gov/display/NICC) presentation from Daniel Rubin, July 6th (under Presentations and Recordings from Previous Calls).
  3. Add indication on website (medici-challenges.org) which challenges accept submissions.
  4. Demo docker submissions to Emily Townley who is designing a MIDRC challenge. I should have a non-gpu and a gpu submission ready soon.
MeetingDate
Bi-weekly Meeting #1

 

Bi-weekly Meeting #2

Milestones

DescriptionDate
  • Data hosting for DL-Sparse challenge is setup

 

  • Google Analytics added. We should discuss what to monitor.

 

  • Python3 and jQuery Update works on my local computer. I am in the process of helping NCI deploy this so we can do an app scan.

 

  • Got VPN access, now just need machine access

 

Task in Progress

DescriptionStatusCreation DateClose Date

Investigated Kheops and am finishing the report. I met with Joël Spaltenstein from Kheops and he helped me setup a fully secured and working Kheops. I will be collecting more notes from this and talking more about it in the report.

In Progress

 


Continued ascertaining the validity of v2 codalab (codabench). I honestly haven't had too much time because of the covid challenge platform. I did get it to launch but there are some issues. I plan to get it all ready and deployed with the MICCAI challenge from last year. Once I have that we can scan it on the NCI platform and run challenges there. Deploy "develop" branch of codabench code to see if it is farther along and more bug free.

In Progress

 

 

Finishing setting up MedNIST and IRIS sample challenges within the kubernetes deployment. This project is a collaboration with Microsoft that has been ongoing since July\August 2020. This should allow us to scale CodaLab up for more users to use and allow a robust docker submission platform. In Progress

 


Risks

DescriptionMitigationRankStatusCreation DateRealizationClose Date
Codabench could prove to be hard to setup and may be buggyNothing we can do but try and see what happens1In Progress

 

We will go with python3 port of codalab for now.

 

  • No labels

1 Comment

  1. Unknown User (bearceba)

    Reorganized the report a little to fit my style and also there were some duplicate sections or sections that I felt talked about similar things to other sections.