Short Presentation Title

Transcription

Short Presentation Title
Service SAP Consulting Solution
HP QC/ALM Scheduler and Failure
Cause Heuristic
Walter Kretschmer
SAP Consulting, Germany
Customer Pain Point
Event
• Customer has built a library of automated test scripts
• He wants to schedule several Test Sets for unattended
execution
• During nightly execution some of them fail
Pain Point
• Within HP QC/ALM a sequence of Test Sets to be executed
cannot be defined.
• Where is the cause of the defect? In the test script, in the used
test data or in the system/solution under test?
Current
Approach
• Test Set execution has to be monitored and manually
scheduled for every single Test Set
• Test engineers have to manually analyze the execution log files
• There is a delay between the execution result and the analysis
result
© 2014 SAP SE or an affiliate company. All rights reserved.
2
Solution
Scheduling of a sequence of Test Sets and automated
analysis of the execution log files based on a
customizable heuristic
Unattended execution of a defined sequence of Test
Sets
Provide execution and analysis result within the
same notification
Heuristic will develop with the degree of experience
Enables the test manager to make a reasonable real
time decision whether to start or stop manual testing
after a software package import on the test system
© 2014 SAP SE or an affiliate company. All rights reserved.
3
SAP HP QC/ALM Scheduler and Failure Cause Heuristic
Heuristics
SAP_ALM_SFCH VB App performs a text search on
HP QTP result files
Heuristics are defined by two logical formulas in DNF
• One for failures with cause in the script and/or data
• One for failures with cause in the system under test
© 2014 SAP SE or an affiliate company. All rights reserved.
4
Notification - Example

Notification includes the execution status and the predicted cause of the failure.
© 2014 SAP SE or an affiliate company. All rights reserved.
5