NIH | National Cancer Institute | NCI Wiki  

Error rendering macro 'rw-search'

null

Versions Compared

Old Version 2

changes.mady.by.user Unknown User (bearceben)

Saved on

compared with

New Version 3

changes.mady.by.user Klinger, Carolyn (NIH/NCI) [C]

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. Integrated Azure's Kubernetes \ Storage \ Networks \ VM pools \ and Docker Registry pieces with CodaLab with the help from Patrick Flickinger. 
    UPDATE:

...

  1.  Ingress and cert-manager are working properly now. We are working to get the challenge upload process to work seamlessly. Seems CodaLab is prepending some links and routes with https instead of http and the normal work flow is interrupted. Patrick is working on a fix.
  2. We did indeed move to a GPU resource pool. I also increased our limits for VMs in East-US and East-US2 to make sure there is enough availability.
  3. All participant dockers have been run an backed up.
  4. A new docker submission video (tutorial) has been made and Carolyn is making edits to it.
  5. Reminded Jayashree to send invoices for July\Aug and Sept (new contract).
Planned for next month
  1. Get PIV card for NIH access.
  2. Create image registry submission for internal COVID challenge.
  3. Add Okta as supported feature in MedICI github and website.
  4. Meet with Ulli, Keyvan and Jayashree to discuss new contract

...

Planned for next month

1) We make the VM resource pool contain GPUs, but we are deploying into US West 2 right now and it needs to be US East for compatibility with this thing called an "Express Route" from Partners to securely transfer data. It is only available in the US East and US East 2 zones.

2) Test Phase ends  9/3 and participant finalists will need their Dockers run on the CBIT platform as well as at MGH.

  • UPDATE: All dockers were run on the an Azure environment (V100 GPU). All 6 finalist's dockers produced results consistent with the results reported on the MedICI platform.

3) Upload Carolyn's video to Medici website.

UPDATE: Need to change it over to youtube hosting
  1. .
Comments

Things that went well:

  • Participant submissions were evaluated successfully
  • However some participants didn't use the right folder naming convention
  • Some didn't have internal code setup correctly to name their own intermediate results properly so that the algorithm ran. I needed to spend some time with 2 participants on zoom calls and 3-4 if you include email correspondence. Not sure how to handle this in the future but automating these submissions will become challenging if they don't just "work" on their own. 
    • Participant docker images are located here for the time being: https://www.dropbox.com/sh/r1nu4ovrjh4j3uf/AADKOeAPknQgEZQFuEOavbDMa?dl=0The internal COVID challenge is having some difficulties but it is clear we are moving forward.
Comments

Things that could be improved:

  • Azure integration is pretty basic still. We need to test a real algorithm on real GPUs.UPDATE: We ended up testing the first architecture run on a GPU machine (while CodaLab was still it's own VM) and everything worked. As we migrate to the new kubernetes deployment of CodaLab we will need to reproduce this functionalityAs far as the new infrastructure is concerned, better documentation would really help. There will be a huge need to collect what "worked" when this is completed.  (same from last month)



MeetingDate
Bi-weekly Meeting #1

06 Aug  

Bi-weekly Meeting #2

20 Aug  

Bi-weekly Meeting #e

Milestones

DescriptionDate

 

...