This document explains how to install CodaLab and is an alternative to the more detailed user manual on the CodaLab Wiki. CodaLab is under active development, so the procedures here are subject to change.
Your first step is to decide which virtual machine or computer you want to install MedICI.
This tutorial focuses on Ubuntu-based installations on Azure, although instructions on how to do this on Microsoft and Apple operating systems and in AWS are also included.
Create a VM in Azure or use a computer with Ubuntu Server 18.04 installed. Once you have an Azure account, go to the Azure home page. A sidebar with many options or categories appears. You can create either a resource or a resource group and then add resources into it. This tutorial uses the resource group method to demonstrate good organizational practices.
Choose Ubuntu Server 18.04 LTS.
The VM creation page appears.
Choose the following settings.
We need to configure the machine to be ssh accessible (port 22) and open http (port 80) (https://medium.com/techinpieces/practical-azure-how-to-enable-ssh-on-azure-vm-84d8fba8103e). Go to the VM and click Networking. On the right find the button Add inbound port rule. Change Destination port ranges to 22, Protocol to TCP, Priority to 330, and Name to anything you’d like:
Once you have that let’s open a terminal and get inside the machine by typing $ ssh <user>@<public IP address>.
If you get a message regarding encryption keys, enter y\yes as this is the first time signing into this machine.
On the right find the button Add inbound port rule. Change the Destination port ranges to 80, Protocol to TCP, Priority to 300, and Name to anything you like.
This step is necessary to access the site once you deploy it.
CodaLab has documentation regarding their preferred installation configuration. The two best sources are the following:
The base code for CodaLab can be set up on different cloud providers (Google Cloud, AWS, Azure). The CodaLab team has made Docker images for AWS and Google cloud that in theory should just run once some settings are established, but require a good working knowledge of Docker. For the purposes of MedICI, it is recommended to follow the “Configure CodaLab from scratch (harder documentation)” procedure found in the first link above.
Before we clone GitHub, we must install docker and docker-compose. Follow the Docker installation instructions to install on Ubuntu.
The following are the commands for a basic installation of Docker on Ubuntu.
$ sudo apt-get remove docker docker-engine docker.io containerd runc $ sudo apt-get update $ sudo apt-get install \ apt-transport-https \ ca-certificates \ curl \ gnupg-agent \ software-properties-common $ curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo apt-key add - $ sudo apt-key fingerprint 0EBFCD88 $ sudo add-apt-repository \ "deb [arch=amd64] https://download.docker.com/linux/ubuntu \ $(lsb_release -cs) \ stable" $ sudo apt-get update $ sudo apt-get install docker-ce docker-ce-cli containerd.io $ sudo docker run hello-world
This creates the following result.
Now if we run the
docker command, we see the options list that tells us how to use the command, which verifies that Docker is installed and we can use it.
Check to see if docker-compose is installed from the terminal on your new virtual machine. If not, rather than use sudo apt install docker-compose, the CodaLab documentation from Configure CodaLab from scratch (harder documentation) says to install it from Docker's website. Use the following command.
sudo curl -L "https://github.com/docker/compose/releases/download/1.25.5/docker-compose-$(uname -s)-$(uname -m)" -o /usr/local/bin/docker-compose
Now change the permissions in /usr/local/bin/docker-compose to use docker-compose:
sudo chmod +x /usr/local/bin/docker-compose
docker-compose in the terminal window. The options list appears that tells us how to use this command. This verifies that docker-compose is installed and ready to use.
The latest code is located in the codalab-competitions folder in the codalab repository (repo) in GitHub. Both sets of instructions direct you to clone this repository locally to the virtual machine. Since we will be customizing our installation, fork the repository and do the following:
$ docker compose up -d.You may encounter the following error:
The solution to this error is to run with sudo or add yourself to the docker group:
$ sudo docker-compose up -d
$ sudo groupadd docker(this may be done already)
$ sudo usermod -aG docker $USER(now restart the VM)
$ docker-compose up -d
The following documentation explains this step: https://codalab-competitions.readthedocs.io/en/latest/
Below is the blob storage section for Azure:
You may sign up for an Azure account, then follow the directions below. You do not have to do this if you've already set up S3.
The CodaLab documentation leaves one final step out. We NEED to enable CORS. Click CORS in the image in the previous procedure and add these settings (https://stackoverflow.com/questions/50785255/azure-storage-got-403-url-cors-not-enabled-or-no-matching-rule-found-for-thi):
If you don’t, uploading a competition will present a CORS errors in the browser:
Once applied, uploading works:
To create a custom logo, follow the Codalab instructions but note that you must log in to the database as the super user to use the customizer module. Django doesn’t have a super user by default, so you must create it. To do so, create a secure connection to the virtual machine that hosts your site and run the following command.
$ docker exec -it django python manage.py createsuperuser
You can now return to the CodaLabs instructions and navigate to http://your-instance.com/customizer. Log in with your super user credentials and choose a new file as your logo.