Overview
Description
A trend report shows the development of performance over time. Multiple measurements are taken into account and evaluated against each other. An XLT trend reports shows you, how your system performs over time, how your tuning effort pays out, and how your live environment acts under changing load situation, if used as monitoring. Two trend report types are available: Difference to First Run and Difference to Previous Run.
The Difference to the First Run reports the changes compared to your first test run, mostly referred to as baseline. Each table column will show you the difference between your baseline run and the run your are interested in. The quality of your baseline run defines how valuable this report may be. You can also see this as long-term performance trend report.
The Difference to Previous Run visualizes the improvements between two adjacent test runs. This shows you, how your last change or tuning effort payed out in comparison to the previous run. It helps you to see whether or not you are on the right track improving the performance of your application. The report also emphasizes sudden improvements or set-backs. This report can also be seen as a short-term performance trend report.
When you hover the mouse over the columns of the trend report table, you will see the actual measurement results. This will give you a better impression whether or not the reported percentage change is significant or not. Please keep in mind, that changes up to 10% are most of the time measurement fluctuation.
Transactions
Description
A transaction is a completed test case. The test case consists of one or more actions. The run time of a transaction contains the runtime of all actions within the test case, thinktimes, and the processing time of the test code itself. If the test path of the test case is heavily randomized, the runtime of transactions might vary significantly. The average runtime shows the development of tests over time and especially helps to evaluate the outcome of long running tests.
| Transaction Name | Difference to First Run | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | |
| TAuthor | 0.0% | -3.4% | -2.7% | -2.5% | -1.3% | -6.3% | -1.1% | +2.0% | +0.1% | -6.2% |
| TDateVisitor | 0.0% | +23.9% | +7.0% | +21.8% | +15.0% | +12.6% | -5.2% | +19.0% | +36.9% | +15.6% |
| TSearchVisitor | 0.0% | +5.5% | -0.2% | +1.7% | +12.7% | +10.4% | +22.4% | +10.9% | +6.5% | -2.3% |
| TVisitor | 0.0% | +5.8% | +0.2% | -0.1% | +1.2% | +2.3% | +5.4% | +0.4% | -2.2% | +0.6% |
| Transaction Name | Difference to Previous Run | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | |
| TAuthor | 0.0% | -3.4% | +0.7% | +0.3% | +1.2% | -5.1% | +5.5% | +3.2% | -1.8% | -6.3% |
| TDateVisitor | 0.0% | +23.9% | -13.6% | +13.8% | -5.6% | -2.1% | -15.8% | +25.6% | +15.0% | -15.6% |
| TSearchVisitor | 0.0% | +5.5% | -5.4% | +1.9% | +10.8% | -2.0% | +10.9% | -9.4% | -3.9% | -8.3% |
| TVisitor | 0.0% | +5.8% | -5.3% | -0.3% | +1.4% | +1.1% | +3.0% | -4.8% | -2.6% | +2.9% |
| Transaction Name | Difference to First Run | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | |
| TAuthor | 0.0% | -4.0% | -2.5% | -1.5% | -1.7% | -1.8% | -0.8% | +2.4% | +0.8% | -1.7% |
| TDateVisitor | 0.0% | +21.1% | +12.5% | +22.4% | +13.5% | +16.1% | +6.6% | +18.0% | +36.7% | +24.0% |
| TSearchVisitor | 0.0% | +8.9% | -2.3% | +4.1% | +12.3% | +7.8% | +17.6% | +17.1% | +3.1% | +0.7% |
| TVisitor | 0.0% | +4.4% | +0.0% | +0.1% | +0.3% | +1.3% | +5.8% | -1.1% | -3.4% | -1.2% |
| Transaction Name | Difference to Previous Run | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | |
| TAuthor | 0.0% | -4.0% | +1.5% | +1.1% | -0.2% | -0.1% | +1.1% | +3.2% | -1.6% | -2.5% |
| TDateVisitor | 0.0% | +21.1% | -7.1% | +8.8% | -7.3% | +2.3% | -8.2% | +10.7% | +15.8% | -9.3% |
| TSearchVisitor | 0.0% | +8.9% | -10.2% | +6.5% | +7.9% | -4.0% | +9.1% | -0.4% | -12.0% | -2.4% |
| TVisitor | 0.0% | +4.4% | -4.2% | +0.0% | +0.3% | +1.0% | +4.4% | -6.5% | -2.3% | +2.3% |
| Transaction Name | Difference to First Run | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | |
| TAuthor | 0.0% | -1.3% | +2.6% | -5.1% | -6.7% | +2.8% | +1.0% | +14.0% | +3.3% | +1.3% |
| TDateVisitor | 0.0% | +37.6% | +44.6% | +68.6% | +78.2% | +72.9% | +33.5% | +60.6% | +60.3% | +80.8% |
| TSearchVisitor | 0.0% | +43.8% | -6.7% | +6.9% | +9.6% | +41.4% | +31.6% | +16.2% | +10.5% | +32.9% |
| TVisitor | 0.0% | -2.3% | -9.5% | -5.2% | -7.1% | -9.0% | +1.8% | -11.2% | -12.0% | -8.7% |
| Transaction Name | Difference to Previous Run | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | |
| TAuthor | 0.0% | -1.3% | +4.0% | -7.5% | -1.7% | +10.2% | -1.7% | +12.9% | -9.4% | -2.0% |
| TDateVisitor | 0.0% | +37.6% | +5.0% | +16.6% | +5.7% | -3.0% | -22.8% | +20.4% | -0.2% | +12.8% |
| TSearchVisitor | 0.0% | +43.8% | -35.1% | +14.6% | +2.6% | +29.0% | -6.9% | -11.7% | -4.8% | +20.2% |
| TVisitor | 0.0% | -2.3% | -7.3% | +4.8% | -2.0% | -2.0% | +11.8% | -12.7% | -0.9% | +3.7% |
| Transaction Name | Difference to First Run | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | |
| TAuthor | 0.0% | +3.1% | -1.4% | +3.4% | +10.0% | +8.6% | +4.0% | -1.2% | +3.4% | +3.7% |
| TDateVisitor | 0.0% | +10.2% | +15.8% | +9.4% | +7.7% | +16.0% | +16.9% | +9.8% | +19.1% | +23.1% |
| TSearchVisitor | 0.0% | +9.4% | -8.3% | +1.1% | -0.0% | -1.1% | -8.0% | -0.3% | -4.1% | -3.6% |
| TVisitor | 0.0% | +2.7% | +9.3% | +18.3% | +1.2% | +1.8% | +10.1% | +8.7% | +4.9% | +0.6% |
| Transaction Name | Difference to Previous Run | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | |
| TAuthor | 0.0% | +3.1% | -4.4% | +4.9% | +6.4% | -1.3% | -4.2% | -5.0% | +4.7% | +0.3% |
| TDateVisitor | 0.0% | +10.2% | +5.1% | -5.5% | -1.6% | +7.6% | +0.9% | -6.2% | +8.5% | +3.3% |
| TSearchVisitor | 0.0% | +9.4% | -16.2% | +10.2% | -1.1% | -1.1% | -6.9% | +8.3% | -3.8% | +0.5% |
| TVisitor | 0.0% | +2.7% | +6.4% | +8.3% | -14.5% | +0.5% | +8.2% | -1.3% | -3.4% | -4.1% |
| Transaction Name | Difference to First Run | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | |
| TAuthor | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% |
| TDateVisitor | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% |
| TSearchVisitor | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% |
| TVisitor | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% |
| Transaction Name | Difference to Previous Run | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | |
| TAuthor | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% |
| TDateVisitor | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% |
| TSearchVisitor | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% |
| TVisitor | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% | 0.0% |
