NIH | National Cancer Institute | NCI Wiki  

Error rendering macro 'rw-search'

null

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 18 Next »

Loading from UMLS RRF (Rich Resource) Files

The Unified Medical Language System regularly releases a set of terminologies in a large set of files referred to as the UMLS Metathesaurus.  LexEVS can load individual files from this file set using the LexEVS RRF loader also known as the LexEVS UMLS Batch loader, due it it's memory optimization capabilities.  We briefly mention the UMLS Metathesaurus tools on this page.  Since all documentation for these is maintained at the website linked to below we don't repeat it here.  As well LexEVS has a special purpose RRF loader which loads an NCI version of an entire MetaThesaurus.  This is dealt with in the NCI loaders and we won't repeat it's use here.

1

Install Metathesaurus to a local folder:
Loading from these sources requires that the UMLS Metathesaurus be installed locally so it can be accessed from LexEVS.  This can be done according to documentation available on the UMLS website.  

2

Subset the desired terminology (optional):
Once the Metathesaurus is downloaded and installed, users can either load from the entire set of files by pointing to the containing file directory or they can use the UMLS tools to subset a terminology (recommended).  Subsetting the terminology beforehand provides improved performance during loads.

3

Set command line options in the loading script:
If you load larger ontologies, we recommend use of the command line options, this will allow manipulation of the memory allocated for loads of larger terminologies such as SNOMED. Scripting options can be added to the scripts contained at <LexEVS install base>/admin  If a user is working on a Linux environment with a 64 bit architecture, then they can use the LoadUmlsBatch.sh file.  On a server class computer with say 16  gigabytes of memory and 8 four core processors users can access fairly substantial resources to load content.   Open the .sh file with a text editor and edit the values for -Xmx and -XX:MaxPermSize as follows "-Xmx6000M -XX:MaxPermSize=256M"  or more if you have adequate resources available. If you have not set the DB_PRIMARY_KEY value to SEQUENTIAL_INTEGER as described earlier it could 33 hours to load a terminology as large as SNOMED which otherwise could complete in 4 hours.

4

Find the SAB (RSAB) in the MRSAB.RRF file
Both the lbGUI and the command line require the user to enter a SAB or source abbreviation. This requires that you either know this source abbreviation, or find it in the MRSAB.RRF file contained in the folder of the UMLS installation or the subset you made for the terminology you wish to load. We recommend you open this file in a text editor and search on the terminology name, for instance SNOMED and you should find a line with that name in a row of text separated by a “pipe” character or “ | ”.


The current format of UMLS has the RSAB in column four. Which in the case of SNOMED is SNOMEDCT. Notice that this is a licensed terminology and all use must be in accordance with the licensing agreement.

5

Load the Terminology from the command line referencing the SAB.
  

./LoadUmlsBatch.sh -in "file:///data/phont/ontologies/2011AA -s SNOMEDCT"

Note: The file path is pointing to the directory directly above the .RRF files.\

6

Monitor output (optional):
The output from the UMLS batch loader indicates steps of the batch load and can be monitored from the logs at <LexEVS Install Root>/logs/LexBIG_load_log.text.
If you are on Linux this can be done using: 


watch --n .1 --d tail LexBIG_load_log.text.

Sample output of an early load step is as follows:

Sample output of a final load step:


|

Restarting a Stopped or Crashed RRF Load

Step

Action

1

Open the lbGUI

2

Find in the table the terminology with the broken or stopped load
This should have a status of pending


3

Highlight and double click the terminology row in the table

4

On the resulting window note for the following command line execution:
The URI and the version.

5

Using the LexEVS utilities restart the load of the RRF source:

{LEXEVS_HOME}/admin

For Windows installation use the following command:

ResumeUmlsBatch.bat-in file:///home/LargeStorage/ontologies/rrf/RXNORM/2011AA/ -s RXNORM -uri "urn:oid:2.16.840.1.113883.6.88" -version "10AB_110307F"

For Linux installation use the following command:

./ResumeUmlsBatch.sh -in file:///home/LargeStorage/ontologies/rrf/RXNORM/2011AA/ -s RXNORM -uri "urn:oid:2.16.840.1.113883.6.88" -version "10AB_110307F"
  • No labels