NIH | National Cancer Institute | NCI Wiki  

Agenda

EVS Discussion

Open System Tickets

Ticket Description Actions, Update

Issues deploying prod software to DataQAWill be moved once all configurations working on Stage/Prod. On Stage now
NCI-INC0778085MEME ticketDNS 

Report Exporter deployment ticketStage

CTS2 / CTS2Docs deployment ticketsStage

SYSTEMS
EVS transition to virtual machines

STATUS: As decided from last week, we will wait to switch STAGE from on prem to VM once PROD VM is ready; so we can switch both PROD and STAGE at same time .

  • Check on status


Systems

BACKGROUND: 

On Friday Sept 29th, we were asked to deploy a banner on public-facing websites if the government was shutdown. There was confusion about who was responsible for which pages - and how to do it quickly (especially if systems groups goes to bare-bones support level. While the government was not shut down, we still want the ability to handle it better in the future.
 
OBJECTIVE
:

 to be able to update public-facing pages with banners quickly and efficiently, with Consistent styling desired for all sites - in case the need ever arises again (in case of another shutdown/emergency/etc)


ACTION:

  • Build responsibility list for public facing pages (Jason Lucas compiled the list) thumbs up 

Application

URL

Developer/POC

Status

Term Browser

https://nciterms.nci.nih.gov/

Guidehouse/Kim Ong

On Stage

Metathesaurus Browser

https://ncim.nci.nih.gov/

Guidehouse/Kim Ong

On Stage

Term Suggestion Application

https://ncitermform.nci.nih.gov/

Guidehouse/Kim Ong

On Stage - deployment issue

EVS Explore

https://evsexplore.semantics.cancer.gov

WCI/Brian Carlsen

On Stage - being tested

EVSRESTAPI (Swagger Page)

https://api-evsrest.nci.nih.gov/swagger-ui/index.html

WCI/Brian Carlsen

On Stage

EVS website

https://evs.nci.nih.gov/

Clint Malone?

On Prod

Report Exporter

https://evs.cancer.gov/report-exporter

Mayo/Andrew Moore

Ticket for Stage

LexEVS CTS2 docs                          

https://lexevscts2docs.nci.nih.gov

Mayo/Tracy Safran

Ticket for Stage

LexEVS CTS2 Landing Page

https://lexevscts2.nci.nih.gov/lexevscts2/

Mayo/Tracy Safran

Ticket for Stage

EVS Semantic Integration Platform

https://sip.evs.cancer.gov/evssip/

ESI/Ye Wu

On Stage


ACTION:




LEXEVS UPDATES

Monthly Planning and Focus

Completed Sprint - Sprint 213 (Oct 2 - Oct 27)   – LINK TO Jira Sprint 213

Current Sprint  - Sprint 214 (Oct 28 - Nov24) LINK TO Jira Sprint 214

For the month of November 2023, the Mayo group is planning to:

  • Complete Report Exporter refactoring and dependency updates

    • (see EVSREPEXP-475 -> 483)

  • RMI Retirement - in progress

    • Unfortunately, I do not have a detailed update at this time, other than there are efforts to update the test script. I believe that the the RMI is turned off on STAGE, and the test script would test other components to verity that there are no unseen side-effects.

  • Improvements, Refactoring Code Debt, Feature development:
    • LEXEVS-5341 Update Spring to Spring 6
    • LEXEVSCTS2-453 Update CTS2 welcome with digital sytle requirements (header, footer, etc)
  • Examine feasibility of Java 17
    • BACKGROUND: a small number of LexEVS components (aka dependencies) are being phased off of java 8 (or are no longer being supported on java 8).  We ideally want to use a current version of those components (dependencies). IF the current version of that component is only supported on Java 14 or later (just as an example), then we would have to migrate the ENTIRE LexEVS stack to Java 14 or later. (Note that the current Java version is Java 21 LTS, and the most popular non-LTS version is Java 14). So there is a risk that a vulnerability is found in the older version of the component/dependency and we would have to either migrate everything quickly to a new version, or not use that component (which might not be possible), or shutdown LexEVS entirely. Note that there are certain versions of Java which are "long-term support" versions - meaning that they will be supported for several years beyond non-LTS versions. LTS versions are Java 8,  Java 11, Java 17, and Java 21.
    • OBJECTIVE: find out what would it be like to upgrade from Java 8 LTS to Java 17 LTS.  How hard would it be? How long might it take?
    • LEXEVS-5361- Investigate Java 17
  • Miscellaneous bug fixes (several small bugs that have been identified over time and need to be addressed)
    • EVSREPEXP-491 resolve branch-download list not being displayed on chrome browser (now FIXED)
    • EVSREPEXP-433 Security issue: set-value vulnerability (in progress)
    • LEXEVSCTS2-452 test_associations_subject_of call revealed hierarchy bug
    • EVSREPEXP-478 Feedback form is not coming up
    • LEXEVS-5252 Read an Entity by URI throwing a 302 error
    • LEXEVSCTS2-431 Service resource does not populate Service name/version
    • Investigate ERROR messages (both reported by Jason Lucas, and in catalina.out )

ACTIONS


Technical Debt remediation

LexEVS Code Debt Refactoring

  • Coding complete on lexevs services - except for isolated dependencies
    • The isolated dependencies largely depend on using an updated version of Java (e.g. they are using more current Java versions. Java 21 LTS is the current version.  The more popular non-LTS Java version is Java 14)
    • Scott is investigating costs and feasibility of Java 17 (see LEXEVS-5361 above)
    • LEXEVSCTS2-447 javax-servlet - on hold, until we update Java 17
    • LEXEVSCTS2-446 spring-boot - on hold, until we update Java 17
  • Work on NCIt Browser - ehcache beta on stage. Already set at 12g for memory
  • CTS2 - JQuery and commons-text


Report Exporter


Banner changes being implemented for potential govt shutdown

  • Moved to Dev but needs Apache configuration change
  • Workaround - hardcoded banner


Feedback form

  • Need to research approval procedure, Mark was asked to reach out to OCPL
  • Andrew supplied copy of survey form from RE

Next work item is adding templates 


ACTIONS


Security

see JQuery issue under Systems

  • Working on commons-lang3/commons-text
  • Possibly move CTS2 behind firewall 

Statistics Dashboard

OBJECTIVE 
Complete Migration of Statistics Dashboard from SumoLogic to DataDog by March 2024

STATUS

The queries used in the Statistics Dashboard have been shared with < someone on migration team > (as of Sept 2023).

They are working on migrating from "SumoLogic" format to DataDog format 

  • SumoLogic Query: 
  • Data Dog Query

<note: removed images of DataDog vs SumoLogic queries, as they didn't add much to the discussion anyway >

ACTIONS


Comparison/Mapping Tool

On Hold

AWS Cloud to be in Separate Account

Waiting on AWS team

Team Absences


Mayo Team -  Andrew off Nov15 & 24, Tracy off 22-24th

MSC - Kim off Tue-Fri

Leidos - 

QA - 

Gov - 



EVS SERVICE AND ARCHITECTURE GROUP UPDATES
EVS Service and Architecture Group

Github repository - NCIEVS impacted. Need to look at user admin responsibility. 

  • Check with Larry Brem to find out procedure for user admin - add new local admin?
  • Other privileges allowing creation of repositories 



DATA UPDATES
Data

DECIDED: 

  • NCIt on Stage - delayed due to high priority banner testing

BROWSER UPDATES

Browser
  • NCITERM-925 - Missing 'maps' link on NCIT on stage. Possibly clash of extension jars on upper tiers. 
    • Considered vital - need to debug before deploying on upper tiers
  • Term-form not working on Stage after deployment. Worked on QA and Dev

QA UPDATES

QA
  • Report Exporter - working on the sanity completion, should be completed today
    • note that this is a manual test/push

TERMINOLOGIES LIFECYCLE REPORT

Terminology Updates and Schedule 


Mark Benson TPM Update

LexEVS Technical Debt Progress


Technical Debt Related Update

Estimated Effort

Status

Report Exporter vulnerabilities - design4 days
Report Exporter vulnerabilities - implementation5 days
Unit testing2 days
QA2 days
Deployment5 days (elapsed)

Vocabularies Slated for Production

  Terminology Updates and Schedule


Vocabulary Name

Local Name

Version

Arrival Date

Loaded to data-qa DB

Date to Stage

Date to Production

Vocabulary Name in LexBIG

Short Name

Version identifier

Date the vocabulary arrived for processing

Has the vocabulary been loaded to the data-qa database?

Approximate date the vocabulary version is scheduled to move to staging

Approximate date the vocabulary version is scheduled to move to production

NCI ThesaurusNCIt23.08d08/28/2023yes09/11/2309/13/23
NCIt-ChEBINCIt-ChEBIAUg202308/28/2023yes09/11/2309/13/23
NCIt-HGNCNCIt-HGNCAug202308/28/2023yes09/11/2309/13/23
SwissProtSwissProtAug202308/28/2023yes09/11/2309/13/23
ChEBIChEBIv22509/05/23yes09/15/2309/18/23
HGNCHGNCSept202309/05/23yes09/15/2309/18/23

QA Schedule and Status

see  QA Scheduling and Status



SECTION FOR FUNCTIONAL SYSTEM TESTING STATUS ::

Application and Version

Percentage Complete

Estimated Completion Date per Iteration

Priority Level 

Type Of Testing

Current Tier for Release (DEV, QA, Stage, Prod)

Expected Production Date

EVS REST API (v1.6)

100%

5/27/2022

High

Progression + Regression 

QA

6/6/2022

EVS Explore (v1.6)

100%

5/27/2022

High

Progression + Regression

QA

6/6/2022

EVS REST API(v1.6)

100%

6/1/2022

High

Regression

Stage

6/6/2022

EVS Explore(v1.6)

100%

6/2/2022

High

Regression

Stage

6/7/2022

EVS REST API(22.05e) - Monthly Data Deployment

100%

6/1/2022

High

Regression

Stage

6/3/2022

EVS REST API(22.05e) - Monthly Data Deployment

100%

6/3/2022

High

Regression

Production

6/3/2022

EVS REST API(v1.6)

100%

6/6/2022

High

Regression

Production

6/6/2022

EVS Explore(v1.6)

100%

6/7/2022

High

Regression

Production

6/7/2022

NCIt,NCIm,TermForm(22.05e + GO & HGNC Jun 2022 Deployment)

100%

6/3/2022

High

Regression

Stage

6/6/2022

NCIt,NCIm,TermForm(22.05e + GO & HGNC Jun 2022 Deployment)

100%

6/6/2022

High

Regression

Production

6/8/2022

EVS REST API(22.06d) - Monthly Data Deployment

100%

6/30/2022

High

Regression

Stage , Production

6/30/2022

NCIt,NCIm,TermForm(22.06d) - Monthly Data Deployment

100%

7/8/2022

High

Smoke

Stage,Production

7/8/2022

NCIt,NCIm,TermForm(22.05e + GO & HGNC Jun 2022 Deployment)

100%

6/3/2022

High

Regression

Stage

6/6/2022

NCIt,NCIm,TermForm(22.06d) - Monthly Data Deployment100%7/8/2022HighSmokeStage,Production7/8/2022
NCIt,NCIm,TermForm(ChEBI, GO & HGNC July 2022 Deployment)100%7/12/2022HighSmokeStage7/12/2022
NCIt,NCIm,TermForm(ChEBI, GO & HGNC July 2022 Deployment)100%7/13/2022HighSmokeProduction7/13/2022

EVS REST API(22.07d) - Monthly Data Deployment

100%

7/27/2022

High

Regression

Stage , Production

7/27/2022

NCIt,NCIm,TermForm(22.07d) - Monthly Data  Deployment100%8/1/2022HighSmokeStage,Production8/1/2022
NCIt,NCIm,TermForm(CanMED, GO & HGNC AUG 2022 Deployment)100%8/3/2022HighSmokeStage,Production8/3/2022

EVS REST API - 1.6.1 (Hot Fix Deployment)

100 %

8/3/2022

Highest

Progression + Regression

Stage,Production

8/4/2022


Attendees

Name

Role

Present

Remennik, LyubovNIH/NCIcheck mark button 

Safran, Tracy

NIH/NCI [C]
Ong, Kim LNIH/NCI [C]check mark button 
Lucas, Jason RNIH/NCI [C]check mark button 
Bauer, Scott  NIH/NCI [C]
Alkis, BarryNIH/NCI [C]<checked in>
Solie, ChuckNIH/NCI [C]
Kondareddy, SwathiNIH/NCI [C]check mark button
Singh, ItendraNIH/NCI [C]check mark button
Zhang, ChaoNIH/NCI [C]check mark button
Johnson, ConnieNIH/NCI [C]
Whiteman, LoriNIH/NCI [C]
Benson, MarkNIH/NCI [C]check mark button
Andrew MooreNIH/NCI [C]



JIRA Issues


Recent EVS Stats Dashboard Related Bugs and Features 

Key Summary T Created Reporter P Status
Loading...
Refresh

Recent Report Exporter Related Bugs and Features 

|

Key Summary T Created Reporter P Status
Loading...
Refresh

Recent LexEVS Related Bugs and Features 

Key Summary T Created Reporter P Status
Loading...
Refresh

Recent CTS2 Service Related Issues 

Key Summary T Created Updated Due Assignee Reporter P Status Resolution
Loading...
Refresh


ASSIGNED ACTION ITEMS

DescriptionDue dateAssigneeTask appears on
09 Oct 2023Benson, Mark (NIH/NCI) [C]LexEVS Meeting Minutes - 2023.10.25
09 Oct 2023Benson, Mark (NIH/NCI) [C]LexEVS Meeting Minutes - 2023.10.18
09 Oct 2023Benson, Mark (NIH/NCI) [C]LexEVS Meeting Minutes - 2023.10.04
  • Benson, Mark (NIH/NCI) [C] to schedule a mtg/ discuss a possible CSS file/ENV variable for banner message and report on  
11 Oct 2023Benson, Mark (NIH/NCI) [C]LexEVS Meeting Minutes - 2023.10.25
11 Oct 2023Benson, Mark (NIH/NCI) [C]LexEVS Meeting Minutes - 2023.10.25
  • Benson, Mark (NIH/NCI) [C] to schedule a mtg/ discuss a possible CSS file/ENV variable for banner message and report on  
11 Oct 2023Benson, Mark (NIH/NCI) [C]LexEVS Meeting Minutes - 2023.10.18
11 Oct 2023Benson, Mark (NIH/NCI) [C]LexEVS Meeting Minutes - 2023.10.18
  • Benson, Mark (NIH/NCI) [C] to schedule a mtg/ discuss a possible CSS file/ENV variable for banner message and report on  
11 Oct 2023Benson, Mark (NIH/NCI) [C]LexEVS Meeting Minutes - 2023.10.11
11 Oct 2023Benson, Mark (NIH/NCI) [C]LexEVS Meeting Minutes - 2023.10.04
  • Benson, Mark (NIH/NCI) [C] to schedule a mtg/ discuss a possible CSS file/ENV variable for banner message and report on  
11 Oct 2023Benson, Mark (NIH/NCI) [C]LexEVS Meeting Minutes - 2023.10.04
25 Oct 2023Safran, Tracy (NIH/NCI) [C]LexEVS Meeting Minutes - 2023.10.04
  • Schedule followup meeting
LexEVS Meeting Minutes - 2024.04.03
  • Tracy to check with team
LexEVS Meeting Minutes - 2024.03.27
  • will need additional work to install Datadog / AWS integration. working with Cyrus and Systems.
LexEVS Meeting Minutes - 2024.02.21
  • will need additional work to install Datadog / AWS integration. working with Cyrus and Systems.
LexEVS Meeting Minutes - 2024.02.14
Benson, Mark (NIH/NCI) [C]LexEVS Meeting Minutes - 2024.02.07
  •  Short meeting to determine audience for app
LexEVS Meeting Minutes - 2024.02.07
  • Mark to reach out by Friday if we don't hear back
LexEVS Meeting Minutes - 2024.01.31
  • Mark to schedule meeting with editors for feedback; Mark has sent out poll for times
LexEVS Meeting Minutes - 2024.01.31
  • Check on status of collectors on other servers than evsexplore - Tracy
LexEVS Meeting Minutes - 2024.01.31



  • No labels