DevOps Automation

 View Only

Reporting and viewing test outcomes made simpler than ever

By Suhas Kashyap posted Wed December 08, 2021 06:13 PM


You determine the quality of an application under test based on the test results, but at the same time, reporting and analysis of those results can be quite a tedious task. It’s imperative that reporting is done in a clear, concise, and consolidated manner, but this can be quite a challenge. 

How will the Reporting app help you tackle the challenge?
The Reporting web application replaces the manual chore of viewing and sharing your test reports. You can access any specific test report right when you want to and can make faster decisions with a complete data set in real time.
The application provides you with a simple, easy-to-navigate dashboard that consolidates all test reports from Test Workbench into one place and gives you a clear view of how your applications under test are performing - without requiring you to open or use multiple different testing products. For example, the user of the Functional Tester product can publish their test results to the reports server so that users involved in Integration Tester can review them.
You no longer need to go through the manual process of zipping the test reports and emailing them to interested parties, just because the reports are local to your installation. After all, you wouldn’t want anyone to bother you with a request for that one simple report while on vacation, would you? The application also serves those who do not intend to install the workbench, but wish to monitor the quality of ongoing test activities on a regular basis.
The following list summarizes  the key capabilities of the Reporting application:

  • View test reports on a web browser whether or not the product installation is local to your workstation.
  • View test reports from multiple test applications (Functional Tester, Test Workbench , and Performance Tester) quickly and easily.
  • View the total number of tests and passed/failed status for every project.
  • Find specific test reports when you need them.
  • Sort and filter test reports.
  • Compare the quality of the application under test (AUT) across projects and test types.
  • Identify trends quickly.
  • Add/remove labels to the test reports to highlight important results.
  • Lock/unlock reports to prevent accidental deletion of critical report information (e.g. end of sprint analysis).

Accessing the application
The Reporting application does all the heavy lifting for you, providing you with a simple dashboard that displays test reports from multiple testing products, updated in near-real time.
The Reporting application is deployed with Rational Test Control Panel. For the initial release, there is an additional URL that you use to access the dashboard:
https://myrtcpserver:5443/results/, where myrtcpserver is the IP address/hostname of the server on which Rational Test Control Panel is running.

 The Reporting dashboard

The Reporting dashboard shows reports from individual projects across multiple testing products represented as pie charts. Within each project, there are legends that summarize the reported metrics as percentages.
To view all the test reports associated with a project, click at the center of the pie chart or anywhere outside of it.

To view only a subset of test reports (say for example, only the reports from tests that failed), click the individual slices of the pie chart.

In the tabular view of the test reports, the following actions are possible:

  • search: You can search through your results based on the project name, a date range (date of the test run), keywords, or labels.
  • Delete: You can select individual test reports by clicking the check box along the left column and then delete them.
  • Lock: You can lock the reports by clicking the lock icon. When a report is locked, you cannot delete it.
  • Filter: You can filter reports based on distinct values.
  • Label: You can select individual reports and label them as needed.
  • Open: You can open the report(s) associated with a test by clicking the test name and selecting the name of a report in the context menu.

Also watch this YouTube video on the Reporting web application

Chris Haggan is the HCL Product Manager, Functional & Performance Test Automation and a member of the World Wide Testing team with over 14 years in the integration testing and service virtualization space. He has worked with numerous clients ensuring that when they modernize and connect their disparate IT systems be it through EAI, SOA or API's, they are successful and efficient.  Connect with me on LinkedIn

Shivi is a senior principal technical writer who has more than 13 years of experience in the software industry. She's currently a member of the Integration Tester project team and works out of the HCL office in Bengaluru.