2020-07-23 Meeting notes

Date

23 Jul 2020

Attendees

Name	Attended
Jayashree Kalpathy-Cramer
Ulli Wagner	Yes
Carolyn Klinger	Yes
Benjamin Bearce	Yes

Goals

Status Update for Medici Helpdesk

Currently supported challenges

Name of Challenge	Organization / Meeting	Medici instance used	Release Training data	Release Test data	Number of Participants	Closing Date	Will the challenge remain open?	Comments
Computed tomography ventilation imaging evaluation 2019 (CTVIE19): AAPM Lung Challenge	AAPM OK	http://aapmchallenges.cloudapp.net/competitions/35	April 5,2019	April 5,2019	56 individuals or teams	May 31,2019	Yes	Conversation with organizer ongoing. Organizer processes data on his end; use of Medici somewhat limited User can no longer submit; data is being evaluated
AAPM Head/Neck Challenge AAPM RT-MAC Challenge	AAPM OK	http://aapmchallenges.cloudapp.net/competitions/34	April 16, 2019	Pre-AAPM June 7, 2019 AAPM Live Challenge July 15, 2019	58 individuals or teams		See description of challenge for details / phases	Competition to start on April 15.
MICCAI Brain Tumor challenge	MICCAI URL not working and 3. are working	https://cpm2019.nci.nih.gov/ http://miccai2019.eastus.cloudapp.azure.com/ http://miccai2019.eastus.cloudapp.azure.com/competitions/2	June	Test phase has ended on 9/18/2019.	Max 5 submissions per account (can be a team or an individual)		Competition was officially accepted for the MICCAI conference. Top participants will go to MICCAI.	2020/01/23 First link was within NCI, first and second URL are duplicates. NCI instance has been taken down.
QIN Breast Challenge		Paul Kinahan University of Washington = challenge organizer Awaiting responses from him to be able to setup page/competition						Release dates currently pending from the organizers. Organized with Keyvan Farahani

Potential challenges:

Name of Challenge

Organization / Meeting

Medici instance
used

Release
Training data

Release
Test data

Number of
Participants

Closing Date

Will the challengeremainopen?

Comments

MRI deidentification for NF event

Robert Allaway from Sage Bionetworks and Wenli Cai from MGH.

na

A Hackathon for the NF Conference. The hackathon is a competition to NF volumetric image analysis, which is a three days event for participants to compete for the solutions to some clinical challenges to NF imaging.

MICCAI 2020

MICCAI has approved it

QIN PET-FDG

blanket approval

Discussion items

Time	Item	Who	Notes
	Action Items		Unknown User (bearceben) June monthly status report
	Monthly status reports		Include MICCAI 2020 work and meetings, include NCI Imaging Informatics webinar preparation and presentation (June report)
	Contract / invoice status		The May invoice received.
	PIV card / GFE laptop / VPN		On hold.
	MICCAI 2020 status		The validation phase started on July 9, 2020. About 30 registrations. The challenge organizers and the test users have been subtracted. (7/9/2020)
	Videos		data submission code submission docker submission (data + code)
	Other challenges		older still open challenges In the next few weeks, Medici might be used by MGH for challenges. It might be a separate effort.
	Reopening old challenges		Funding was provided with the contract. Who is going to decide which challenges should be re-opened? How is this going to happen? How are we going to publicize this?
	URLs		Practice Codalab in general for developing new features: http://medici-codalab-master.eastus.cloudapp.azure.com/ MedICI website: http://medici-codalab-master.eastus.cloudapp.azure.com:5000/ https://www.medici-challenges.org/ Practice MICCAI 2020 site to practice docker submission integration: https://miccai2020.eastus.cloudapp.azure.com/ Actual MICCAI 2020 challenge site: https://miccai.westus2.cloudapp.azure.com/
	Strategy meeting		review paper open challenges back up (contract / funding) website
	Incoming help desk requests
	Other work		testing of new version of CodaLab Docker submission improvements

Action items

Content

Space Tools