NIH | National Cancer Institute | NCI Wiki  

Error rendering macro 'rw-search'

null

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 3 Next »

 

 

Contents of this Page

The purpose of this page is to compare the results we found from testing both the site-to-site VPN and the software VPN.  To do this, we connected to both VPNs at random times over the course of a week and performed X window forwarding of the Eclipse IDE and a browser window.  We recorded the response time it took for multiple tasks to complete including a button click, text entry, window resize, and highlighting a table row.

Site To Site VPN

  • How many times tested
    • Monday
      • 3:00 PM findings
        • lbGUI(Scott)
          resizing limited probably works as below
          2 to ten second delay in window resolution
          1 second delay in response to button press
          3 to 4 second delay to highlight table row
          No delay in text entry.   
      • 4:50 PM findings
        • lbGUI(Scott)
          resizing solved
          2 to ten second delay in window resolution
          1 second delay in response to button press, radio button activation
          3 to 4 second delay to highlight table row
          Maybe a bit slower response on the text edit but admittedly usable 
    • Tuesday
      • 8:50 AM findings
        • Eclipse(Scott) 
          Startup time about a minute and a half to open the application
          Windowing about 2 to 5 seconds.
          Starting a new Java Project
          2 to 3 second lag on right click to package explorer
          10 seconds plus opening java project window
          5 second lag entering project name in the text box, not very usable
          1 to 2 second lag on opening project
          Almost a 20 second lag time opening new class wizard
          Similar lag time in text box for class creation of 5 seconds
          Crashed on class creation
          This version of eclipse is apparently unusable on this kernel version.  It keeps crashing.  I’ll download another version 
    • Wednesday
      • 2:30 PM findings
        • Eclipse Neon With Java8 (Scott)
          1.5 minute startup, but launched differently
          5 second delay on right click
          3 second wizard startup
          text box lag seems to be absent
          class editing is still jittery.  Irritating, but more usable than delays by seconds we’ve seen. 
          Eclipse runs without crashing — so far. 

    • Thursday
      • 1PM findings
        • Eclipse Neon With Java8 (Scott)
          Startup about 1:30 minutes
          Right click response about 5 seconds
          Wizard startup about 4 - 6 seconds
          1-2 second delays in opening project folders
          check boxes have one second delay
          Text box entries and Text Editing is jittery but no long delays 
    • Friday
      • 4:20PM findings
        • Eclipse Neon With Java8 (Scott)
          Startup about a minute 10 seconds
          Right click response time about 4 seconds: This is the one constant usability issue worth complaining about.
          Window response about 5 seconds
          Text box entry lag is sub second
          Three seconds response to open folder
          Check box response is sub second but noticeable
          Usual jitteriness in the text editor 
  • Findings
    • How many times un-usable
      • If it had not crashed on class create, Eclipse Juno would still have had usability issues when with an unacceptable time delay on one occasion.  
      • Other factors add to overall usability including consistently slow wizard window start up and long delays in right click menus.  None of these are quite as bad as text entry lag.
      • Jittery text entry is irritating in the java editor, but it's still usable
    • Eclipse neon did not crash and never showed the unacceptable text entry time delay of Eclipse Juno.  Hard to tell if that was application or network related.
    • Overall S2S is slightly, but noticeably, slower than the software VPN

 

 

Software VPN

  • How many times tested
    • Monday
      • 3:00 PM findings
        • lbGUI(Scott)
          Resizing works from resize button
          Might be slightly faster window resolution
          button response seems slightly faster
          Notable difference in slower text entry delay 
      • 4:50 PM findings
        • lbGUI(Scott)
          Resizing works from resize button in upper left hand corner.   Cannot manually resize, but it’s not a usability issue show stopper
          2 to ten second delay in window resolution
          button response about the same as above
          Text edit same as above.  
          Not really seeing a difference in lag time this time of day 
    • Tuesday
      • 8:50 AM findings
        • Eclipse(Scott)
          Startup time about 30 seconds faster
          Window startup for new Java Project about 12 secounds
          No Text Entry Lag for project name
          Window startup for new Class project about 5 seconds
          No Text Entry Lag for class name
          Eclipse did not crash on Class creation
          Did crash on class editing
          Will attempt a new eclipse install for the next cycle of tests.   
    • Wednesday
      • 8:50 AM findings
        • Eclipse Neon With Java8 (Scott)
          half minute startup
          1 to five second window startup
          noticeable but usable text box lag in Project and Class wizards.
          class editing is a little jittery.
          Eclipse running smoothly against jdk 1.8
          jittery editing does not get faster over time.


    • Thursday
      • 1PM findings
        • Eclipse Neon With Java8 (Scott)
          50 second startup
          slightly faster right click response
          Wizard response 4 seconds
          project and other folders open sub second
          check boxes have one second delay but are sometimes faster here
          editing is still jittery and about the same as S2S 
    • Friday
      • 4:20 PM findings
        • Eclipse Neon With Java8 (Scott)
          Startup about a minute 10 seconds
          Right click response time about 5 seconds
          Window response about 5 seconds
          Text box entry is flawless 
          Three seconds response to open folder
          Check box response is sub second but noticeable
          Usual jitteriness in the text editor 
  • Findings
    • How many times un-usable
      • Eclipse juno crashed consistently. This had more to do with application fault than network issues.   
      • Other factors add to overall usability including consistently slow wizard window start up and long delays in right click menus.
      • Jittery text entry is irritating in the java editor, but it's still usable
    • Eclipse neon did not crash. 
    • Overall slightly faster than S2S by a second or two in most functions.  Much faster startup time for some reason. 

Conclusion

Site to Site is slower, more prone to unacceptable time delays and much less flexible than software VPN.  


 




 

  • No labels