Short Presentation Title
Transcription
Short Presentation Title
Service SAP Consulting Solution HP QC/ALM Scheduler and Failure Cause Heuristic Walter Kretschmer SAP Consulting, Germany Customer Pain Point Event • Customer has built a library of automated test scripts • He wants to schedule several Test Sets for unattended execution • During nightly execution some of them fail Pain Point • Within HP QC/ALM a sequence of Test Sets to be executed cannot be defined. • Where is the cause of the defect? In the test script, in the used test data or in the system/solution under test? Current Approach • Test Set execution has to be monitored and manually scheduled for every single Test Set • Test engineers have to manually analyze the execution log files • There is a delay between the execution result and the analysis result © 2014 SAP SE or an affiliate company. All rights reserved. 2 Solution Scheduling of a sequence of Test Sets and automated analysis of the execution log files based on a customizable heuristic Unattended execution of a defined sequence of Test Sets Provide execution and analysis result within the same notification Heuristic will develop with the degree of experience Enables the test manager to make a reasonable real time decision whether to start or stop manual testing after a software package import on the test system © 2014 SAP SE or an affiliate company. All rights reserved. 3 SAP HP QC/ALM Scheduler and Failure Cause Heuristic Heuristics SAP_ALM_SFCH VB App performs a text search on HP QTP result files Heuristics are defined by two logical formulas in DNF • One for failures with cause in the script and/or data • One for failures with cause in the system under test © 2014 SAP SE or an affiliate company. All rights reserved. 4 Notification - Example Notification includes the execution status and the predicted cause of the failure. © 2014 SAP SE or an affiliate company. All rights reserved. 5