NIH | National Cancer Institute | NCI Wiki  

Error rendering macro 'rw-search'

null

Versions Compared

Old Version 1

changes.mady.by.user Unknown User (bearceben)

Saved on

compared with

New Version 2

changes.mady.by.user Unknown User (bearceben)

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

1) Talked with NCI, Spyridon and Tahsin and discussed hardware requirements and things to keep in mind for future challengesRe-implemented docker submissions for MedICI site (should work for upcoming challenges).


Planned for next month

1)

Document installation of epad and caMicroscope

Fine tune code changes.

2)

Learn how to use ePAD and caMicroscope within MedICI (CodaLab)

QA implementation by re-creating MICCAI 2019 challenge and submitting dockers to test implementation.

Comments

Things that went well:

  • We ran the dockers successfully. 

    • Do we want to continue using docker containers? Yes

  • Participants were able to submit their resultant *.csv files relatively easily.

  • *.tiff files are better to hide meta-data and are more simple. 


Things that could be improved:

  • The participant dockers seemed to be able to delete a couple of images. I think participants shouldn’t be able to adjust files their containers are mounted to. This might be as simple as read-only permissions. Cuong says we can mount files to dockers with read-only permissions.

  • We should finalize metrics for the evaluate.py script so that the final leaderboard columns are as we expected.

  • We should know if we will need to use shm (shared memory size) before hand:

$ sudo docker run --runtime=nvidia --shm-size 50G -v /home/bbearce/input_images:/data/images -v /home/bbearce/yunzhe_docker_run/output_result:/data/output xyzacademic/njit_datasci:cpmv

  • Remember to delete the index.html files that come with a curl or wget command. This caused some errors and confusion for participants.

  • Docker worker container needs updated python for certain scikit-learn methods.

  • Is there any way to check if a team has multiple screen names or accounts ahead of time?

  • FTP:

    • Server on same VM as CodaLab.

    • Have data available all year so participants have more time. 

...