DevOps Automation

DevOps Automation

Join this online group to communicate across IBM product users and experts by sharing advice and best practices with peers and staying up to date regarding product enhancements.


#DevOps
 View Only
  • 1.  Ask the Experts : Performance Testing on Private or Public Cloud

    Posted Thu October 06, 2016 05:55 PM

    If a web application is hosted on OpenStock Cloud and Test Lead wants to perform load testing of more than 1500 concurrent global users. What factors need to be taken into account as compared to testing it on a dedicated server and not in cloud? 

    *This question was asked during an Ask the Experts webcast. Watch here: https://www.imwuc.org/p/do/sd/sid=3226 *



  • 2.  RE: Ask the Experts : Performance Testing on Private or Public Cloud

    Posted Thu October 06, 2016 07:30 PM

    (Note: We discuss some network-related considerations on the "Ask the Expert" call, the replay link is elsewhere on this page).  

    Certainly, there are differences for cloud-specific workloads vs a dedicated server (see 'auditing' link below).  But I'd suggest that it might be more important to consider where a load test originates vs where a target system/application is running.  Both can be on dedicated servers, either could be cloud-based, or both could be cloud-based.  For internal services (whether on private cloud or dedicated servers) internal load generation will have the lowest latency --- and the latency will be more consistent for the duration of a test. There is, as you imply, some impact from the presence of cloud - this is discussed further at the auditing link, below (though it targets 'virtualization' as a topic, clouds share the same factors).

    For public cloud-based applications - whether on OpenStack, Softlayer bare-metal servers, or PaaS clouds like Bluemix, there will be larger latency with less consistency, as the internet will be used to carry traffic.  The goals of public cloud-based load generation often include the ability to generate traffic from globally-distributed locations, which implies that latency is not as important in this situation.

    Luckily, Rational Performance Tester includes special capabilities that help to minimize the impact of choosing to test over the internet.  For more information, please see "Auditing measurement accuracy" at http://www.ibm.com/support/knowledgecenter/SSMMM5_9.0.0/com.ibm.rational.test.lt.doc/topics/c_audit_meas_accuracy.html

     

    Bill Hudacek

     Service/API Testing and Service Virtualization, Performance Testing - "All Things Testing"

    IBM

    These opinions are my own, not those of my employer.



  • 3.  RE: Ask the Experts : Performance Testing on Private or Public Cloud

    Posted Tue October 11, 2016 08:10 PM

    Thanks for providing this info, Bill! You're such an awesome resource to our members :)