Activities completed this month
  1. Integrated Azure's Kubernetes \ Storage \ Networks \ VM pools \ and Docker Registry pieces with CodaLab with the help from Patrick Flickinger. 
    UPDATE: Ingress and cert-manager are working properly now. We are working to get the challenge upload process to work seamlessly. Seems CodaLab is prepending some links and routes with https instead of http and the normal workflow is interrupted. Patrick is working on a fix.
  2. We did indeed move to a GPU resource pool. I also increased our limits for VMs in East-US and East-US2 to make sure there is enough availability.
  3. All participant dockers have been run an backed up.
  4. A new docker submission video (tutorial) has been made and Carolyn is making edits to it.
  5. Reminded Jayashree to send invoices for July\Aug and Sept (new contract).
Planned for next month
  1. Get PIV card for NIH access.
  2. Create image registry submission for internal COVID challenge.
  3. Add Okta as supported feature in MedICI GitHub and website.
  4. Meet with Ulli, Keyvan, and Jayashree to discuss new contract.
Comments

Things that went well:

  • The internal COVID challenge is having some difficulties but it is clear we are moving forward.
Comments

Things that could be improved:

  • As far as the new infrastructure is concerned, better documentation would really help. There will be a huge need to collect what "worked" when this is completed. (same from last month)
MeetingDate
Bi-weekly Meeting #1

 

Bi-weekly Meeting #2

 

Bi-weekly Meeting #e

 

Milestones

DescriptionDate

 

Task

DescriptionResolutionStatusCreation DateClose Date

Get sample pneumonia algorithm running on Azure VM

Need to increase quotacomplete

 

 

Get pools of VMs in Azure integration to be based on GPU machines


Depends on above taskpending

 

 

Risks

DescriptionMitigationRankStatusCreation DateRealizationClose Date
Ingress service in Kubernetes is not behaving like the standard tutorials or documentationKeep plugging away to find the correct configuration1closed

 

Azure has inconsistent docs on how to set this service up.--

Challenge taking too long to setup. People are worried about it failing to materialize

We really need a solid deployment of this architecture on Azure. Basic functionality is not working and some of the harder stuff is still being developed.

1

Open

 

Now that CodaLab has been deconstructed from its normal configuration (postgres as an azure service rather than container; codalab as a pod in kubernetes instead of container; codalab code in azure file shares rather than the host machine), getting all the pieces to talk to one another isn’t working seamlessly yet.

--