NIH | National Cancer Institute | NCI Wiki  

Versions Compared

Old Version 1

changes.mady.by.user Safran, Tracy (NIH/NCI) [C]

Saved on

compared with

New Version Current

changes.mady.by.user Safran, Tracy (NIH/NCI) [C]

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Agenda

EVS Discussion

Open System Tickets

Ticket Description Actions, Update

NCI-RITM0520059/NCI-SCTASK0867247

CTS2 down on Dev and QA
Met with Systems team to debug on Tu, Feb 27.
Ticket entered to install visual VM to track stack on Visual VM working Dev

NCI-RITM0512149

Security consult about IP traffic to Prod
Asked for dynamic IP throttling
Working to escalate using WAF (Web Application Firewall)
Mark to keep close eye on this

 NCI-RITM0524607

Add DataDog collectors to Prod2 server

Pinged today to check status

NCI-INC0822712

Report Exporter Stage server not working

NCI-RITM0514215Remove Extensions folder from Stage and Prod

Complete

MultipleRequests to remove all SumoLogic collectors

Systems working on this


Mount point failures on jenkins

Affects ftp updates.


Data Deployments to Dev and QAAccess to S3 bucket for verifying DataDog logs


EVS transition to virtual machines

STATUS:

  • Prod2 server up and running - completed tested
  • DATAQA next


  • Tomcat 8.5 reached EoL - needing new stacks for all tiers
    • Oracles OES8, Tomcat 10, Java 17 
      • Java 17 implemented
      • Others to follow once 17 on Pro
    • Options
      • Tomcat 9 and Java 17 installed on Dev
      • evs-jenkins working for NCItBrowser and lexevscts2
      • OES8 could come later
    • NCItermform installed on Dev - needs testing
  • Stage 2 - all upgrade
  • Prod 2 - all upgrade
    • OEL8 needed
  • Kathy Coleman watching the progress
  • Tomcat 9 installed on Dev.  
    • Jenkins complete for NCItBrowser and CTS2
    • Recoding needed for NCIm
    • NCI Term Form needs testing
  •  Check status of termform and Tomcat9 - 
  •  Meeting scheduled Thursday for Visual VM



LEXEVS UPDATES

Monthly Planning and Focus

Completed Sprint - Sprint 219 (Mar 5 - May 10) -

Current Sprint  - Sprint 220 (May 13 - May 31) - 

For the month of May 2024

Technical Debt remediation

LexEVS Code Debt Refactoring - Java 17 refactoring currently is in progress

  • Tomcat 9 installed on Dev.  
    • Jenkins complete for NCItBrowser and CTD2
    • Recoding needed for NCIm
Report Exporter
  • Working on templating starting
    • Doing phase 1 - moved to Stage
      • Code not being accepted on search - same tag as QA
      • Stage EVS Rest API having issues
      • Cloud team addressing the issueRollback to previous did not resolve issueUnable to retrieve codes
    • In progress: implement file-based template storage
      • Code completed
      • On Dev issue with Rest APi affecting testing - working currently
        • Tomcat 9 testing - working with systems to find resolution
        • Having trouble moving page to page - possible http/https conflict
    • Moving Dev and QA to run from 7AM-10PM


Security

Tomcat 8.5 is EOL - risk if new vulnerability discovered

  • Oracle Java 8 - still being used on DataQA
    • Still present on other servers, in $PATHTracy to put in tickets - once data out for May
    • Java 17 being added next week
  • Protege servers are on Oracle Java 8now Corretto on Dev and QA
    • Need to check upper tiers

Statistics Dashboard

OBJECTIVE 
Complete Migration of Statistics Dashboard from SumoLogic to DataDog by March June 1 2024.  Hard end in April (ish) - possibly end of June  

STATUS

  • S3 bucket has been created
    • Working on integration
    • successfully tested refresh
    • need to operationalize - testing going on today
  • Collectors installed on all servers 
    • Apache config complete
  • Apache logs being pulled in for p805
    • evs.cancer.gov now working
      • EVSRESTAPI/EVSExplorer - fixed
      • FTP1 downloads - needs tweaking.fixed
  • Prod 2 collectors installed, need pipelines
  • New Dashboards being made - can be shared

Link: Sharepoint Project Task Checklist

Comparison/Mapping Tool

On Hold

  • Moved to 7-10
  • shutdown to save resources?
    • Is old architecture so needs update work if kept
    • Per Lyubov - can shut down server for now
  • Systems asking if we still want to maintain the dev server for EVSCompare
  • Will release current cloud instance
AWS Cloud to be in Separate Account

Waiting on AWS team

Team Absences


Mayo Team - Scott working vacation late May - Starting May 16, Andrew June 17-23

MSC - Kim off  5/13-5/15 

Leidos - 

QA - 

Gov -  Memorial Day Monday May 27



EVS SERVICE AND ARCHITECTURE GROUP UPDATES
EVS Service and Architecture Group

Discussion about migrations and status.

DataQA to be rebooted to update OS


DATA UPDATES
Data
  • NCIt published last week
  • Monthlies are on Stage and being tested. Prod this week
  •  NCIt 23.04 going to Prod tomorrow
  • Monthly data on DataQA

BROWSER UPDATES

Browser
  •  Possibly reboot NCIt every morning? Idea rejected
  • This week has been calm
  •  Restarting 3 times today
  • Need to schedule follow up meeting

QA UPDATES

QA
  • Prod Deployment testing for the NCIt completed 24.04e data review
  • Monthlies being tested on StageWaiting on systems issue on Stage for Report Exporter
  • Ad hoc testing on NCIt and NCIm last week for migrations

TERMINOLOGIES LIFECYCLE REPORT

Terminology Updates and Schedule 

Mark Benson TPM UpdateCBIIT to AWS connection physically cut a few days ago.  Issues have been occurring since then.


Vocabularies Slated for Production

  Terminology Updates and Schedule

...

Vocabulary Name

Local Name

Version

Arrival Date

Loaded to data-qa DB

Date to Stage

Date to Production

Vocabulary Name in LexBIG

Short Name

Version identifier

Date the vocabulary arrived for processing

Has the vocabulary been loaded to the data-qa database?

Approximate date the vocabulary version is scheduled to move to staging

Approximate date the vocabulary version is scheduled to move to production

NCI ThesaurusNCIt24.02d02/27/2024yes03/05/2403/09/24
NCIt-HGNCNCIt-HGNCFeb202402/27/2024yes03/05/2403/09/24
SwissProtSwissProtFeb202402/27/2024yes03/05/2403/09/24
CanMedCanMedFeb202403/09/24yes03/12/2403/17/24
ChEBIChEBIv23103/09/24yes03/12/2403/17/24
HGNCHGNCMar202403/09/24yes03/12/2403/17/24

QA Schedule and Status

see  QA Scheduling and Status

...

Application and Version

Percentage Complete

Estimated Completion Date per Iteration

Priority Level 

Type Of Testing

Current Tier for Release (DEV, QA, Stage, Prod)

Expected Production Date

EVS REST API (v1.6)

100%

5/27/2022

High

Progression + Regression 

QA

6/6/2022

EVS Explore (v1.6)

100%

5/27/2022

High

Progression + Regression

QA

6/6/2022

EVS REST API(v1.6)

100%

6/1/2022

High

Regression

Stage

6/6/2022

EVS Explore(v1.6)

100%

6/2/2022

High

Regression

Stage

6/7/2022

EVS REST API(22.05e) - Monthly Data Deployment

100%

6/1/2022

High

Regression

Stage

6/3/2022

EVS REST API(22.05e) - Monthly Data Deployment

100%

6/3/2022

High

Regression

Production

6/3/2022

EVS REST API(v1.6)

100%

6/6/2022

High

Regression

Production

6/6/2022

EVS Explore(v1.6)

100%

6/7/2022

High

Regression

Production

6/7/2022

NCIt,NCIm,TermForm(22.05e + GO & HGNC Jun 2022 Deployment)

100%

6/3/2022

High

Regression

Stage

6/6/2022

NCIt,NCIm,TermForm(22.05e + GO & HGNC Jun 2022 Deployment)

100%

6/6/2022

High

Regression

Production

6/8/2022

EVS REST API(22.06d) - Monthly Data Deployment

100%

6/30/2022

High

Regression

Stage , Production

6/30/2022

NCIt,NCIm,TermForm(22.06d) - Monthly Data Deployment

100%

7/8/2022

High

Smoke

Stage,Production

7/8/2022

NCIt,NCIm,TermForm(22.05e + GO & HGNC Jun 2022 Deployment)

100%

6/3/2022

High

Regression

Stage

6/6/2022

NCIt,NCIm,TermForm(22.06d) - Monthly Data Deployment100%7/8/2022HighSmokeStage,Production7/8/2022
NCIt,NCIm,TermForm(ChEBI, GO & HGNC July 2022 Deployment)100%7/12/2022HighSmokeStage7/12/2022
NCIt,NCIm,TermForm(ChEBI, GO & HGNC July 2022 Deployment)100%7/13/2022HighSmokeProduction7/13/2022

EVS REST API(22.07d) - Monthly Data Deployment

100%

7/27/2022

High

Regression

Stage , Production

7/27/2022

NCIt,NCIm,TermForm(22.07d) - Monthly Data  Deployment100%8/1/2022HighSmokeStage,Production8/1/2022
NCIt,NCIm,TermForm(CanMED, GO & HGNC AUG 2022 Deployment)100%8/3/2022HighSmokeStage,Production8/3/2022

EVS REST API - 1.6.1 (Hot Fix Deployment)

100 %

8/3/2022

Highest

Progression + Regression

Stage,Production

8/4/2022


Attendees

Name

Role

Present

Remennik, LyubovNIH/NCIcheck mark button 

Safran, Tracy

NIH/NCI [C]
Ong, Kim LNIH/NCI [C]check mark button 
Lucas, Jason RNIH/NCI [C]check mark button 
Bauer, Scott  NIH/NCI [C]
Alkis, BarryNIH/NCI [C]<checked in>
Solie, ChuckNIH/NCI [C]
Kondareddy, SwathiNIH/NCI [C]check mark button
Singh, ItendraNIH/NCI [C]check mark button
Zhang, ChaoNIH/NCI [C]check mark button
Johnson, ConnieNIH/NCI [C]
Whiteman, LoriNIH/NCI [C]
Benson, MarkNIH/NCI [C]check mark button
Andrew MooreNIH/NCI [C]



JIRA Issues


Recent EVS Stats Dashboard Related Bugs and Features 

Jira
serverNCI Tracker
columnIdsissuekey,summary,issuetype,created,reporter,priority,status
columnskey,summary,type,created,reporter,priority,status
maximumIssues20
jqlQueryproject = EVSSTATS and updated >=2023-01-01
serverId7954a81f-12da-3366-a0ef-97c806660e7c

Recent Report Exporter Related Bugs and Features 

|

Jira
serverNCI Tracker
columnIdsissuekey,summary,issuetype,created,reporter,priority,status
columnskey,summary,type,created,reporter,priority,status
maximumIssues20
jqlQueryproject = EVSREPEXP AND updated >=2023-09-01
serverId7954a81f-12da-3366-a0ef-97c806660e7c

Recent LexEVS Related Bugs and Features 

Jira
serverNCI Tracker
columnIdsissuekey,summary,issuetype,created,reporter,priority,status
columnskey,summary,type,created,reporter,priority,status
maximumIssues20
jqlQueryproject = LEXEVS AND updated >= 2023-09-01 AND status in ('OPEN', 'IN PROGRESS', 'QA VERIFIED', 'ON HOLD', 'REOPENED')
serverId7954a81f-12da-3366-a0ef-97c806660e7c

Recent CTS2 Service Related Issues 

Jira
serverNCI Tracker
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
maximumIssues20
jqlQueryproject = LEXEVSCTS2 AND (TYPE = bug or TYPE = "new feature" or TYPE ="Improvement" or TYPE ="Inquiry" or TYPE ="Task" ) AND updated >=2023-09-01
serverId7954a81f-12da-3366-a0ef-97c806660e7c

...