The CSSI DCC Portal is a public repository of experiment-related information describing cancer research investigations. You can use the portal to browse, search, and access data generated through CSSI funded projects and other user uploaded data sets. This data is in ISA-Tab format, which organizes investigation, study, and assay data according to the rules in the ISA-Tab specification .
Each data set contains three files--investigation, study, and assay--that conform to the ISA-Tab structure and naming conventions. Within this structure are fields that are standard for each type of file, though null values are allowed; that is, not every data set includes values for each field. The portal allows you to filter these fields in an interactive way so that you can visualize the data in a pie chart or list.
You can search investigations, studies, and assays using any keyword. You can download selected files, the entire data archive, or only the metadata associated with a study. You can also upload and publish your own investigation data to the portal.
The following sections provide detailed instructions on how to browse, search, and download data.
You can continue exploring investigation data by clicking a link to investigation, study, or assay details. Links to these details are on the Browse Investigations page or on the Search Investigations page, after you search on a keyword or phrase. These details include counts of studies, assays, samples, and files. The metadata available for an investigation determines if other entities, such as sources and collections, are available for counts. From these details pages, you can visualize the structure of the investigation and download selected study files, download the full archive, and download only the metadata.
To explore investigation details
Browse investigations or search investigations until you find an investigation, a study, or an assay in which you are interested.
The search results appear.
Click the link corresponding with the investigation, study, or assay you are interested in exploring.
The respective investigation details, study details, or assay details page appears.
The study details page shows the investigation name at the top followed by a visualization of the investigation filename, study filename and number of samples in the study, and assay filename and number of files (and total file size) in the assay. Below the visualization are links to download all or part of the investigation, its identifier, and its description. All of the icons on the page are clickable links.
The assay details page shows the study name at the top followed by a visualization of the investigation filename, study filename and number of samples in the study, and assay filename and number of files (and total file size) in the assay. Below the visualization are links to download all or part of the assay, its file name, measurement type, and technology type. In the Visualize and Select section, the relationship of the study to its processes, and its processes to its files, are depicted in clickable icons. Click any icon to further filter the investigation data and download only a selected portion of it.
Once you browse or search the CSSI DCC data sets and reach a selected investigation details, study details, or assay details page, you can continue exploring the data. The ISA-Tab format is hierarchical, with investigation components becoming more granular as you proceed down the hierarchy. The largest organizing entity is the investigation, which holds one or more studies. Each study includes one or more assays. Assays are composed of samples, which in turn are composed of protocols. Data files are often associated with a protocol.
The following diagram depicts the hierarchy, without the samples and protocols.
The investigation details page shows icons that represent the relationship of the investigation to its studies and assays. In the case of PSON Cell Line Genomic Characterization - mRNA, the investigation has one study and one assay.
You cannot filter data currently at the investigation level any further in the CSSI DCC Portal. You can only download the investigation's full data at this point, or start exploring its studies and assays.
If any investigation has more than one study and assay, you can select which ones you want to filter by clicking the Select Multiple Objects box.
For example, the following investigation has many studies and assays, so it displays horizontally with a slider on the side to move up and down. It also has zoom out and zoom in buttons to see more or fewer objects.
Select the boxes next to the objects you want to visualize and filter. If you download these objects, all of these objects will be included in the download.
If you select the study in the PSON Cell Line Genomic Characterization - mRNA investigation or arrive at any other Study Details page through a search, you can visualize the study's file structure and filter on any field.
You can also select multiple objects to visualize and filter within a single investigation.
To visualize and select study data
In the Visualize and Select area, click one of the entities.
The hierarchy of entities for studies according to the ISA-Tab standard is as follows, from less granular to more granular: Source > Protocol > Sample |
For example, click Source. Metadata for that source appears.
Follow this same procedure if you want to filter on Protocol or Sample instead of Source. |
s_mrna.txt
, to the three selected in this procedure.If you select the assay in the PSON Cell Line Genomic Characterization - mRNA investigation or arrive at any other Assay Details page through a search, you can visualize the assay's file structure and filter on any field.
You can also select multiple objects to visualize and filter within a single investigation.
To visualize and select assay data
In the Visualize and Select area, click one of the entities. Note that the width of some visualizations require you to scroll by clicking the arrows at the bottom of the page.
The hierarchy of entities for assays according to the ISA-Tab standard is as follows, from less granular to more granular: Sample > Protocol > Data File |
For example, click the sample. Metadata for the sample appears.
Follow this same procedure if you want to filter on protocol instead of sample. |
Click one or more values in the list to select them. To select multiple values, click one, wait for it to appear on the Metadata for Sample page, and then click the arrow again to select another value. To clear a selection, click that value again.
Some entities do not have associated metadata fields on which you can filter the study or assay. In that case, when you click the icon for that entity, you see a message letting you know that no metadata fields are available. |
You can search for investigations, studies, or assays in the CSSI DCC Portal by:
In the search results, click View next to a matching term to see where in the investigation this term occurs.
A detailed search results window appears. The matching term, cell, is highlighted in the metadata of each file in the ISA-Tab archive.
To close the window, click Ok at the bottom or the x in the upper-right corner of the window.
After reaching an investigation entity (such as investigation, study, assay, source, protocol, sample, or data file), you can download the full data, selected metadata, or selected data associated with that entity. The full data is always associated with the investigation as a whole. All of the data currently in the portal is public.
Also note that if you selected multiple objects to visualize and filter, a download includes all of those objects.
Metadata describes the structure of the data collected in an investigation and translates to the file columns, field definitions, and placeholders that appear in a spreadsheet. It is in Investigation-Study-Assay tab-delimited format (ISA-Tab), which is based on the ISA-Tab specification .
The data files often contain image files and spreadsheets and can be a large file size.
Each download option has a button on the Investigation Details, Study Details, and Assay Details pages.
An investigation's full data file is always available for download. However, due to the processing resources required, downloads via the Add to Download button are currently limited to 30GB. |
You do not have to log in before downloading the full data from an investigation. If you are not logged in, when you request the full data, you are prompted to provide your email address. You will receive a link at that address you can use to access and download the data. If you are logged in, you have the option of using Globus to download the file.
To download full data
Click the Download Full Data button.
The Request Data Files dialog appears. It offers different options depending on whether or not you are logged in to CSSI DCC.
If you are not logged in, enter your email address and then click Download. Your browser prompts you to save full_archive.zip.
If you are logged in, you have two options: 1) transfer the file with Globus, which is useful when the file is very large, or 2) download the file to your computer now.
If you choose to transfer the file with Globus, click the checkbox and then click Download. The Transfer Files page in Globus opens. For more information about transferring files with Globus, see Uploading Files with Globus or Globus Support .
If you choose to download the file now, just click Download.
Your browser prompts you to open or save full_archive.zip.
It may be useful to rename the .zip file as you save it to include the name of the investigation so that you can identify it more easily. For example, miRNA_full.zip. |
For example, the following dialog box appears in Google Chrome.
Follow your browser's instructions to open or save the file.
An entity's metadata shows how that entity is structured. Metadata files are usually small text files, so you can download them directly to your computer. You do not need to log in before downloading metadata files.
To download selected metadata
On the Investigation Details page, click Download Selected Metadata.
Your browser prompts you to open or save the .zip file. Follow your browser's instructions to open or save the file.
It may be useful to rename the .zip file as you save it to include the name of the investigation so that you can identify it more easily. For example, miRNA_metadata.zip. |
The archive file is in compressed format. When you download it, it may be a single compressed folder or .zip file. When you open it, you see at minimum three text files at the root of the folder or file. An example of these follow.
The text files describe the investigation, study or studies, and assay or assays. In this example, 10290 represents the file identifier but in practice, each file identifier may be named differently, even in the same investigation. Only the a, i, or s prefix is required. If you download full data or selected data, the archive may also contain other files or folders as appropriate for the investigation; for example, images. If you download metadata, the archive only includes the a, i, and s files. |
Globus is a service that enables large file transfers securely. You must have an account with Globus and install Globus Connect Personal to use it to download investigation files to CSSI DCC. If you do not already have an account, you are prompted to create one when you start the download process.
To download files using Globus
If you have not confirmed your Globus ID previously, the Globus Upload window appears, prompting you do to so.
If prompted to do so, enter your Globus ID (an email address) and click Confirm. The Download Requested window appears.
You will receive an email when the request is granted and the transfer succeeds.