|Meeting with Codalab developers|
Ben is attending meetings. He is helping with fixing bugs.
Ben to review the federated learning tasks and discuss with Codalab team.
|Responses to question about keeping challenges open|
Bearce, Benjamin (NIH/NCI) [C] - investigate options on how to keep challenges open, add phase or copy challenge, avoid having users add to the previous submissions
SPIE-AAPM-NCI DAIR Digital Breast Tomosynthesis Lesion Detection Challenge (DBTex) - Phase 1 - Bearce, Benjamin (NIH/NCI) [C] verify with submitters that decision of phase 2 applies to phase 1
SPIE-AAPM-NCI-DAIR & SPIE-AAPM-NCI-DAIR Phase 2 - TBD - (Nick Konz, Wed 11/24/2021 11:36 AM) "Maciej and I discussed this and an idea that we’ve been floating is to have some sort of ongoing validation phase, that would allow anyone to get validation results on their model. We would also want to have a periodic, occasional test phase for people to get test results.
BMMR2 - close on as previously planned. (David Newitt, Thu 10/28/2021 7:10 PM) - link to the challenge data will be de-activated on 12/1/2021.
DL Sparse - keep open (Emil Sidky, Thu 10/28/2021 11:42 PM)
MICCAI 2020 - has already an open test phase
ISBI 2018 - has already an open test phase
AAPM RT-MAC Challenge - is open-ended
MIDRC classification challenge (frontal/lateral views)
AAPM - SIPRISE challenge - Diane Alvares, Baptist Health. She filled out the submission form and sent instructions.
|Information sharing||Ben established connection with developers of Codalab/Codabench. He will join their meeting and potentially take a more active role in product development. These activities can be charged to the contract.|
|Monthly status reports||due on the 10th day of the following month|
|Contract / invoice status / SOW|
|Paper||The draft will be submitted by September 15, 2020. - Not received|
Federated learning challenge - proposal for MICCAI, ACR confirmed that the data can be used
Wagner, Ulrike (NIH/NCI) [C] Change SOW, take cloud out, put federated learning modifications for Codalab in, send to Medici for review