NIH | National Cancer Institute | NCI Wiki  

Agenda


EVS Discussion


Open System Tickets

TicketDescriptionActions
NCI-RITM0413810EVS Explore URL updates to evsexplore-stage.semantics.cancer.gov on Stage tierlooking for an update; can we get this done before 4/19 ?
NCI-INC0735332https://nciterms-qa.nci.nih.gov/ Receiving the following error: The server encountered an internal error or misconfiguration and was unable to complete your request.Need help diagnosing why the QA tier keeps going down. I am able to restart the application to get it working, but the issue is that it keeps going down.
NCI-RITM0431625Test your web application for security vulnerabilities.This security scan is running now and the person with the ticket has been responsive.
NCI-INC0736448 https://ncim.nci.nih.gov/ and https://nciterms.nci.nih.gov/ I am getting an error that the sites cannot be reached. When I go directly to the hostname URL's the applications are running. http://nciws-p805.nci.nih.gov:9080/ncitbrowser/ and http://nciws-p805.nci.nih.gov:11080/ncimbrowser/This is now fixed but we I do have an open request to find out why it was down and how it was fixed.
NCI-RITM0428873Maven refusing to deploy jarsWork with Tracy to get credentials working.  David Talluri contacted on 4/5 and is diagnosing the issue.
NCI-INC0735890 Disk space full on DataQA; remove unused database dumps; close down extra instanceNeed to verify that unused instance was closed down

SYSTEMS
Systems

Discussion Points:

  • working with Systems team is in transition
    • Current point of contacts include Krish Seshadri (System Owner and Architect); (please include and cc: Mark on any communication)
    • We don't have anyone specific yet for building out the rest of the VMs
    • Going forward, there are two teams, organized by tiers:
      • System Engineering team is responsible for the system integration and deployment activities in the lower tiers (Dev/QA)
      • Systems Operations team is responsible for the production tiers (QA/Prod)
  • Trying to get attention from systems, so we went a list of tickets that are currently open, asking for attention
    • working on a list of tickets will hopefully keep the conversation organized and communicate our needs clearly
    • And thank you for keeping this list current: Systems Ticket Chart



LEXEVS UPDATES
Future Planning

Planning for April - EVS Plans for April 2023.png

  • Priorities and Goals for April are
    • Complete Report Exporter Update from Vue2 → 3
    • Complete Refactoring Phase 1 - Vulnerable Dependencies
    • Estimate workload, schedule for Phase 2
    • Start Refactoring Phase 2 - Update Dependencies to Current Version
    • Test Java 8 migration to Corretto
    • Write and review Comparison Mapping Tool User Stories and Requirements
    • Review Devops and Communication channels and needs
    • Proposal for "Health" dashboard for EVS infrastructure

LexEVS Sprint Status


Current Sprint - Sprint 204 (Mar 28 - Apr 13 2023)

16X237 Agile Development - Sprint Status#16X237AgileDevelopmentSprintStatus-Sprint204
  • Snehal has Jira access
    • March reports should proceed normally
    • Add daily activity to User stories being considered
    • ADO tickets migrated by Mark
  • Vue3 Updates for Report Exporter nearing completion
  • Working on updating ncitbrowser for Spring 5 - on dev -  https://ncit-dev.nci.nih.gov
    • Scott working on summary of changes
    • Metathesaurus browser to come
  • LexEVS/CTS2 on Dev - manual deploy
    • Unit testing in progress - one bug fixed
Technical Debt remediation

LexEVS Code Debt Refactoring

caDSR Query

Discussion Points:

Statistics Dashboard

Discussion Points: 

  • Google analytics - Retiring GA and going to GA4
    • Need further experimentation, documentation
      • Check for local documentation, post to wiki
    • Per Kim - looks like scripts need to be updated from UA to GA4
      • Double check all parties notified
      • EVSExplore
      • NCI Metathesaurus Browser - on QA - waiting on scan, vulnerability issue
      • NCI Terms Browser - on QA - waiting on scan, vulnerability issue
    • No analytics being collected by EVS Explore
    • Add to Report Exporter and EVS Compare
      • EVS Exporter working 
      • EVS Compare created
  • Sumo Logic issues

Decision Points:

Comparison/Mapping Tool

Plan is to update product roadmap by end of April.

Mark is working on user stories and requirements

EVS transition to virtual machines

Status: ON HOLD

  • We are waiting to hear from Systems on who will be doing next set of work
  • Chuck shared an email about the work that he did for EVS
  • Will get a new person to replace Chuck, start on next phase (Stage), but that resource hasn't been identified yet

Reference: Wiki page: Server Migration 2021

Report Exporter

  • Discussion Points:

    • Working on update to Vue3 (JavaScript Framework). EVSREPEXP-451
      • Due: Mar 10 (end of sprint 205); on week 16 of estimated 16
      • master ticket: EVSREPEXP-442 - Migrate Vue.js version from 2.0 to 3.0
      • Description
        • On Dev and being regression tested
          • Addressing items in unit testing
          • Issue with tree display on "Resolve Branch" screen.  Issues resolved and in testing in Dev
          • Exporter later feature on Resolve Branch needs tweaking -  complete
          • Duplicate items in list box - might be data issue - being diagnosed
          • Release notes being written
    • UA to GA4 migration - already completed
    • Vulnerable dependencies
    • Demo wanted in the near future - maybe May

    Decision Points:

AWS Cloud to be in Separate Account

Discussion Points

  • Frozen

Decision Points:

Team Absences


Mayo Team - Andrew off April 7, April 27 - May 1

MSC -

Leidos - Chao off April 3-5

Systems - 


EVS SERVICE AND ARCHITECTURE GROUP UPDATES
EVS Service and Architecture Group

Discussion Points:

Decision Points:


DATA UPDATES
Data

Discussion Points: 

  • 23.03

Decision Points:


BROWSER UPDATES

Browser


  • User issue - value set number of concepts discrepancy reported by user
  • NetSparker detected vulnerability (cross-site scripting) in NCI-t (production and stage).
    • Need to contact Cuong to get more information - Mark to reply to email



QA UPDATES

QA

Discussion Points:  (see chart)

  • 23.02 data lifecycle completed
  • GA upgrade test completed on QA, deployment in progress

Decision Points: 



TERMINOLOGIES LIFECYCLE REPORT

Terminology Updates and Schedule 

Discussion Points: 

Decision Points: 

Mark Benson TPM Update

Spreadsheet: EVS Service Tickets.xlsx


Systems Progress

Ticket

Description

Action Items

NCI-RITM0413810

EVS Explore URL updates to evsexplore-stage.semantics.cancer.gov on Stage tier

looking for an update; can we get this done before 4/19 ?

NCI-INC0735332

https://nciterms-qa.nci.nih.gov/ Receiving the following error: The server encountered an internal error or misconfiguration and was unable to complete your request.

Need help diagnosing why the QA tier keeps going down.  I am able to restart the application to get it working, but the issue is that it keeps going down.

NCI-RITM0431625

Test your web application for security vulnerabilities.

No action needed.

This security scan is running now and the person with the ticket has been responsive.

NCI-INC0736448 

https://ncim.nci.nih.gov/ and https://nciterms.nci.nih.gov/ I am getting an error that the sites cannot be reached. When I go directly to the hostname URL's the applications are running. http://nciws-p805.nci.nih.gov:9080/ncitbrowser/and http://nciws-p805.nci.nih.gov:11080/ncimbrowser/

This is now fixed but we I do have an open request to find out why it was down and how it was fixed.

NCI-RITM0428873

Maven refusing to deploy jars (giving permissions error)

Work with Tracy to get permissions working

NCI-INC0735890

Disk space full on DataQA; remove unused database dumps; close down extra instance

Need to verify that unused instance was closed down

LexEVS Technical Debt Progress


Technical Debt Related Update

Estimated Effort

Start Date

Complete Date

Status

JIRA

ADO Ticket

Code Inventory4 days12/20/221/30/23Complete
2037998
Lexevs - update "easy" jars2 days1/31/232/13/23Complete
2111723
Update ddlutils - research and design3 days2/2/232/15/23Complete
2122958
Update ddltils - implementations10 days2/15/233/8/23Complete
2141127
Lexevs Unit testing2 days3/8/2023
In ProgressLEXEVS-53252141156
CTS2 lexevs-service vulnerability update2 days3/13/20233/20/23Complete
2141189
CTS2 unit testing2 days3/20/23
In ProgressLEXEVS-53262141198
QA Lexevs / CTS2

3 days




LEXEVS-53272141217
Repair QA issues2 days




Deployment Lexevs / CTS25 days (elapsed)



2141227
Update LexEVS to Java 11 - research and design4 days



2152899
LexEVS Java 11 implementation5 days



2152917
lucene 9 - research and design8 days



2145025
lucene 9 - implementation15 days



2145027
LexEVS Java 11 unit testing3 days



2152921
CTS2 lexevs-service Java 11 - research and design 3 days



2152928
CTS2 lexevs-service Java 11 implementation3 days



2152932
CTS2 unit testing2 days



2152941
QA Lexevs / CTS2

3 days





2152945
Repair QA issues2 days



2153023
Update Jenkins1 day



2152947
Deployment Lexevs / CTS210 days (elapsed)



2152950
lexevs-service-rest-docs vulnerability update design2 days




lexevs-service-rest-docs vulnerability implementation4 days




lexevs-service-rest-docs unit testing1 day




lexevs-service-rest-docs QA

1 day






lexevs-service-rest-docs deployment4 days (elapsed)




lexevs-service-rest-docs Java 11 design

2 days






lexevs-service-rest-docs Java 11 implementation3 days




lexevs-service-rest-docs unit testing1 day




lexevs-service-rest-docs QA

1 day






lexevs-system-test design4 days




lexevs-system-test implementation6 days




lexevs remaining dependency updates - design10 days




lexevs remaining dependency updates - implementation20 days




CTS2 remaining dependency updates - design1 day




CTS2 remaining dependency updates - implementation3 days




Unit testing2 days




QA2 days




Deployment5 days (elapsed)




Total Effort (Approximately)104 days




Technical Debt Related Update

Estimated Effort

Status

Report Exporter vulnerabilities - design4 days
Report Exporter vulnerabilities - implementation5 days
Unit testing2 days
QA2 days
Deployment5 days (elapsed)

Vocabularies Slated for Production

 Terminology Updates and Schedule


Vocabulary Name

Local Name

Version

Arrival Date

Loaded to data-qa DB

Date to Stage

Date to Production

Vocabulary Name in LexBIG

Short Name

Version identifier

Date the vocabulary arrived for processing

Has the vocabulary been loaded to the data-qa database?

Approximate date the vocabulary version is scheduled to move to staging

Approximate date the vocabulary version is scheduled to move to production

NCI ThesaurusNCIt23.03d03/27/2023yes

NCIt-HGNCNCIt-HGNCMar202303/27/2023yes

SwissProtSwissProtMar202303/27/2023yes

MetaThesaurusMETA20230203/13/2023yes03/29/2303/31/23

QA Schedule and Status

see QA Scheduling and Status



SECTION FOR FUNCTIONAL SYSTEM TESTING STATUS ::

Application and Version

Percentage Complete

Estimated Completion Date per Iteration

Priority Level 

Type Of Testing

Current Tier for Release (DEV, QA, Stage, Prod)

Expected Production Date

EVS REST API (v1.6)

100%

5/27/2022

High

Progression + Regression 

QA

6/6/2022

EVS Explore (v1.6)

100%

5/27/2022

High

Progression + Regression

QA

6/6/2022

EVS REST API(v1.6)

100%

6/1/2022

High

Regression

Stage

6/6/2022

EVS Explore(v1.6)

100%

6/2/2022

High

Regression

Stage

6/7/2022

EVS REST API(22.05e) - Monthly Data Deployment

100%

6/1/2022

High

Regression

Stage

6/3/2022

EVS REST API(22.05e) - Monthly Data Deployment

100%

6/3/2022

High

Regression

Production

6/3/2022

EVS REST API(v1.6)

100%

6/6/2022

High

Regression

Production

6/6/2022

EVS Explore(v1.6)

100%

6/7/2022

High

Regression

Production

6/7/2022

NCIt,NCIm,TermForm(22.05e + GO & HGNC Jun 2022 Deployment)

100%

6/3/2022

High

Regression

Stage

6/6/2022

NCIt,NCIm,TermForm(22.05e + GO & HGNC Jun 2022 Deployment)

100%

6/6/2022

High

Regression

Production

6/8/2022

EVS REST API(22.06d) - Monthly Data Deployment

100%

6/30/2022

High

Regression

Stage , Production

6/30/2022

NCIt,NCIm,TermForm(22.06d) - Monthly Data Deployment

100%

7/8/2022

High

Smoke

Stage,Production

7/8/2022

NCIt,NCIm,TermForm(22.05e + GO & HGNC Jun 2022 Deployment)

100%

6/3/2022

High

Regression

Stage

6/6/2022

NCIt,NCIm,TermForm(22.06d) - Monthly Data Deployment100%7/8/2022HighSmokeStage,Production7/8/2022
NCIt,NCIm,TermForm(ChEBI, GO & HGNC July 2022 Deployment)100%7/12/2022HighSmokeStage7/12/2022
NCIt,NCIm,TermForm(ChEBI, GO & HGNC July 2022 Deployment)100%7/13/2022HighSmokeProduction7/13/2022

EVS REST API(22.07d) - Monthly Data Deployment

100%

7/27/2022

High

Regression

Stage , Production

7/27/2022

NCIt,NCIm,TermForm(22.07d) - Monthly Data  Deployment100%8/1/2022HighSmokeStage,Production8/1/2022
NCIt,NCIm,TermForm(CanMED, GO & HGNC AUG 2022 Deployment)100%8/3/2022HighSmokeStage,Production8/3/2022

EVS REST API - 1.6.1 (Hot Fix Deployment)

100 %

8/3/2022

Highest

Progression + Regression

Stage,Production

8/4/2022


Attendees

Name

Role

Present

Remennik, LyubovNIH/NCI

Safran, Tracy

NIH/NCI [C]
Ong, Kim LNIH/NCI [C]
Lucas, Jason RNIH/NCI [C]
Bauer, Scott  NIH/NCI [C]
Alkis, BarryNIH/NCI [C]
Solie, ChuckNIH/NCI [C]
Truong, TracyNIH/NCI [C]
Kondareddy, SwathiNIH/NCI [C]
Singh, ItendraNIH/NCI [C]
Zhang, ChaoNIH/NCI [C]
Johnson, ConnieNIH/NCI [C]
Whiteman, LoriNIH/NCI [C]
Benson, MarkNIH/NCI [C]
Andrew MooreNIH/NCI [C]



JIRA Issues


Recent EVS Stats Dashboard Related Bugs and Features (within last week)

Key Summary T Created Reporter P Status
Refresh

Recent Report Exporter Related Bugs and Features (within last week)

Key Summary T Created Reporter P Status
Refresh

Recent LexEVS Related Bugs and Features (within last week)

Key Summary T Created Reporter P Status
Refresh

Recent CTS2 Service Related Issues (within last week)

Key Summary T Created Updated Due Assignee Reporter P Status Resolution
Refresh

6.5 LexEVS Related Issues

Key Summary T Created Updated Due Assignee Reporter P Status Resolution
Refresh

6.5 CTS2 Service Related Issues

Key Summary T Created Updated Due Assignee Reporter P Status Resolution
Refresh


---

  • No labels