Search - Testimony - Administrators Guide

Synthetic System Load

Product Screens / Functions » Utilities » Synthetic System Load

Purpose This screen lets you trigger synthetic system load upon a target system in order to support testing of Testimony itself. Data is first generated for various transaction types and placed into batches. Then these batches are run against the target system in…

System Manager

Product Screens / Functions » Utilities » System Manager

Purpose This utility enables you to take snapshots of SAP systems as a part of the Testimony process (soon after activating a recording). You can also restore the snapshot into a pre-configured test system. Audience / Users Testimony…

System Manager

Purpose This utility enables you to take snapshots of SAP systems as a part of the Testimony process (soon after activating a recording). You can also restore the snapshot into a pre-configured test system. Audience / Users Testimony…

System Setup

Administrators Guide » Test Plan and System Connections » System Setup

Select Test Plan to change Use the drop down menu to select your newly created Test Plan and click the Tick. Now you can click Change Plan Systems In the main window, you will see the Test Plan header information. Select the Systems tab and click the Create…

File System Monitoring

Product Screens / Functions » Recording Functions » File System Monitoring

Purpose From the screens displayed here you can configure directories upon which files that are accessed will be recorded. Those files accessed are then displayed in the “Monitoring” screens for the given source systems in the current test plan. Audience…

Test Plan and System Connections

Administrators Guide » Test Plan and System Connections

Overview The Test Plan in Testimony is the “container” for all testing activities that take place within Testimony. Each Test Plan can be configured to represent a regression test cycle such as a Monthly Release, Project or SAP Upgrade undergoing testing. You can…

Utilities

Product Screens / Functions » Utilities

This drawer menu provides additional Utilities that are available within Testimony including: Software Manager Synthetic System Load A detailed explanation of each of these functions is provided in the following sections of the user guide.

Additional configuration

Product Screens / Functions » Configuration Functions » Additional configuration

Purpose The tables listed can be checked or configured using the standard tools for table maintenance. These tables are not available for maintenance within the standard UI. Configuration table Description /BTI/AUT_C_IOMS Input / output average…

Performing a Recording

Administrators Guide » Performing a Recording

Overview The Recording phase can occur once a Test Plan has been created with the associated Source and Target systems identified. It’s important to have an understanding of the anticipated activity load on the source system to help guide the amount of timefor…

Change Plan

Product Screens / Functions » Overview Functions » Change Plan

Purpose This screen enables all facets of the current Test Plan to be changed. Changes can be made on the respective tab for the header information, the source and target systems and their mapping, the test phases/cycles plus users involved in this particular…

Preparing Playback

Administrators Guide » Performing a Playback » Preparing Playback

Overview When you are ready to run a test phase leveraging the Playback capability in Testimony, you need to first prepare the Target system. Process Steps Select Test Plan to use Activate enhancements – Prepares the system for playback of all…

Technical Overview

Product Overview » Technical Overview

The following steps provide an overview at a more technical level of how the Testimony product operates. Installation Process Testimony is installed as a third-party add-on solution to a central ABAP system (typically your SAP Solution Manager system). Transports…

Monitoring a Recording

Administrators Guide » Performing a Recording » Monitoring a Recording

Overview During the recording phase, which may last for any length of time, it is important whilst you become accustomed to Testimony that you monitor the production systems that are being recorded. There are various standard SAP tools that can be used to monitor the…

Glossary

Bot The bot is an executable program that resides on a windows machine (normally a virtual machine). During playback the bot machines log on as the recorded users and execute the recorded transactions. The requirements for bot setup can be found here. Central…

Instrumentation Points

Product Screens / Functions » Recording Functions » Instrumentation Points

Purpose The instrumentation point section allows you to see all objects in a particular system that have been instrumented. Please select a source system first and then navigate through all objects in that system which have been instrumented.

Instrumentation Point Setup

Product Screens / Functions » Recording Functions » Instrumentation Point Setup

Purpose The instrumentation point setup allows you to see all objects in a particular system that can be instrumented. Please select a source system first and then navigate through all objects in that system to see what can be instrumented.

Shared Memory Explorer

Administrators Guide » Performing a Recording » Monitoring a Recording » Shared Memory Explorer

Overview Shared memory is used by Testimony to achieve near zero impact upon the production systems during the recording phase. Therefore, it is important to be able to monitor the shared memory in the system being recorded, This can be achieved in the source system…

Display Plan

Product Screens / Functions » Overview Functions » Display Plan

Purpose This screen provides details of the current Test Plan. The information is presented on different tabs to show the header information, the source and target systems and their mapping, plus the users involved in this particular plan. Audience / Users All…

Enhancement Setup

Product Screens / Functions » Recording Functions » Enhancement Setup

Purpose The enhancement point section allows users to see all objects, in a particular system, that have been instrumented. Please select a source system first and then navigate through all objects in that system which have been instrumented. Audience / Users All…

Software Manager

Product Screens / Functions » Utilities » Software Manager

Purpose All software required to run Testimony is available within this screen including the core central system software, recording and execution agents, bot agent for supporting systems and start/stop scripts to reset the time on the playback system. From here it is…

Usage Retrieval

Administrators Guide » Analyzing Coverage » Usage Retrieval

Introduction The first step in the coverage analysis process is to retrieve the usage data from the source system. In this step, Testimony will connect to the source system and retrieve workload statistics data (from the ST03N repository) for a period that you…

SAP Roles

Administrators Guide » Security » SAP Roles

Testimony is delivered with the following SAP authorization roles: Role Name Description /BTI/AUT_BATCH_ADMIN Background Processing Administrator Role for the Default Batch User during playback /BTI/AUT_BOT_RFC Authorizations…

Recording Preparation

Administrators Guide » Performing a Recording » Recording Preparation

Overview When you are ready to run a test phase leveraging the recording / learning capability in Testimony, you need to first prepare the source systems. Process Steps Select Test Plan to use Generate Inbound RFC Capture – Prepares for inbound RFC calls to…

License Keys

Product Screens / Functions » Overview Functions » License Keys

Purpose Testimony is licensed by the central system and the individual production systems that are to be recorded. Within this screen users can see existing licenses that are currently installed and add/change existing ones. Once a License key has expired, Testimony…

Coverage Analysis

Product Screens / Functions » Execution Functions » Coverage Analysis

Purpose The recording process has effectively generated an entire test script library covering over N% of the customers actual SAP system usage (where N would be expected to range from 70% to 90%). After the recording process is finished, the testing team can…

Standard Scripts

Product Screens / Functions » Repository Functions » Standard Scripts

Purpose The Test Script Repository displays all test scripts that have been created from business transactions or those that have been manually added. Please select a source system to view the test scripts that have been generated or added for that system. Audience /…

Shared Memory Limits

Product Screens / Functions » Configuration Functions » Shared Memory Limits

Purpose Shared memory is used extensively in Testimony to achieve near zero impact upon the production systems during the recording phase. The shared memory settings are specified here which be adjusted to acceptable levels across the entire production application…

Securing Recordings and Results

Administrators Guide » Security » Securing Recordings and Results

It is also possible to secure access to potentailly sensitive information by enforcing an authority check for the Testimony user attemtping to view test results. This can be achieved in the General parameters section for the object “Authority check for data…

Review Playback Results

Administrators Guide » Review Playback Results

Overview When Testimony records activity in a system, it captures inputs, outputs and certain linkages that occur in-between. When the playback is executed in the test system, Testimony will automatically check that the output in the playback matches the output that…

Recording Status

Product Screens / Functions » Recording Functions » Recording Status

Purpose This area shows the user the recording status of the current test plan across all recording agents in all source systems. A user can either start, pause or stop the current recording within the source systems of the current test plan. Audience / Users All…

Coverage Analysis

Administrators Guide » Analyzing Coverage » Coverage Analysis

Introduction Now that the usage information has been retrieved from the source system and the prioritisation run as completed, you can run the coverage analysis proper. The coverage analysis run will compare the transaction volumes captured in your recording (by…

Stop Recording

Administrators Guide » Performing a Recording » Stop Recording

Once you have executed the recording for the time period you planned, stop the recording as follows. Navigate to Recording -> Recording Status. Double-click on the Recording Status row for your system and you should see your recording running in the Recording history…

Creating a Test Plan

Administrators Guide » Test Plan and System Connections » Creating a Test Plan

Access Testimony Once logged into the Testimony central system, enter transaction /n/bti/aut. This will display the Testimony main menu. To create a new blank plan, select the create button You will be presented with a screen where you enter a test plan name…

Monitor Playback

Administrators Guide » Performing a Playback » Monitor Playback

From within the Execution Queues window, click on the Monitoring tab to see status information for the playback. This shows information on (reading clockwise from top-left) the currently-running execution queue blocks; the active Bot(s); the jobs that are running…

Start Recording

Administrators Guide » Performing a Recording » Start Recording

Overview There are two types of recordings you can perform with Testimony. The most common and the one that will be shown below is a Standard Recording. A Standard Recording will record all activity in the Source system until the recording is stopped. The second…

Administrators Guide

The quick start guide is to be used after installation and includes the key basic steps required to create a recording and a playback. Please check the installation guide here if that process is not complete. It details the process steps required to allow you to use…

Analyzing Coverage

Administrators Guide » Analyzing Coverage

Overview A Testimony recording generates, from real-life activity, an entire test script library which covers a high percentage of your actual SAP system usage. How big a percentage this is (i.e., the coverage you have achieved) depends firstly on the length of the…

Supporting Infrastructure

Product Screens / Functions » Execution Functions » Supporting Infrastructure

Purpose Additional systems must be setup in order to support the playback process which is carried out by the “bot” agents and which must be installed on these machines. In addition to the maintenance of these systems, their status can be viewed…

Customer Usage

Product Screens / Functions » Utilities » Customer Usage

Purpose Customer usage allows you to understand the most commonly used objects in a customers system at an aggregate level in order to understand coverage, priority and exclusion configuration.

Script Transformation

Product Screens / Functions » Repository Functions » Script Transformation

Purpose The Test Script Transformation functionality is for use when systems that are recorded are not played back into systems that are identical. This is typically in scenarios such as when the target system is scrambled or consolidated. Audience /…

Test Script Library

Product Screens / Functions » Repository Functions » Test Script Library

Purpose The Test Script Library enables you to manage test scripts that exist across all test plans in the central system. In many ways, they are similar to Adhoc test scripts but instead can be re-used across as many test plans as required. Audience /…

Outbound RFC Setup

Product Screens / Functions » Recording Functions » Outbound RFC Setup

Purpose In order to enable service virtualization during playback, you must first set up outbound RFC capture. The first stage is to perform an analysis of the existing source system(s) and then activate the outbound RFC capture before recording. Audience /…

Prioritization

Administrators Guide » Analyzing Coverage » Prioritization

Introduction The next step is to prioritise the transactions, batch jobs, etc. that have been retrieved from the source system. Testimony prioritises the usage data as follows: First of all, it prioritises by frequency of execution in the source system. The most…

Software Support

After appropriate testing on your SAP test systems, you are now ready to use Testimony within your productive landscape. Remember that Testimony is dormant in your SAP system until activated for recording. You must ensure that Testimony recordings are deactivated after…

Shared Memory Explorer

Product Screens / Functions » Utilities » Shared Memory Explorer

Purpose This screen allows you to monitor the shared memory levels upon the remote systems that are being recorded. You can select a particular application server upon a particular system and see the individual objects residing in SHM. Audience / Users Testimony…

Filtered Recordings

Product Screens / Functions » Recording Functions » Filtered Recordings

Purpose Filtered recordings are generated when a source system is recorded in “filtered” mode. This allows you to restrict which users, types or objects are recorded so that they can then be used to generate “adhoc” test scripts. Audience /…

Version Info

Product Screens / Functions » Overview Functions » Version Info

Purpose This screen provides product version information, showing the current installed version of Testimony for the central system. Additionally, users are able to see the current versions of the software installed into the source and target systems of the current…

Managing Test Plans

Administrators Guide » Test Plan and System Connections » Managing Test Plans

As well as maintaining Test Plans from the Overview -> Change Plan screen (as previously shown) it is also possible to maintain them without first having to select the individual plan. Navigate to Test Plans item from the Configuration section. You will see a list of…

Review Recordings/Transfer to Repository

Administrators Guide » Review Recordings/Transfer to Repository

Verifying that recording has captured activity After the recording has been completed, the captured recordings will be moved from the source systems into the central system. You are then able to review what has been captured. To check that your recording has captured…

Filter Sets

Administrators Guide » Filter Sets

Overview Filter sets are the way to configure Testimony to limit the selection of what is recorded and played back for a test and/or to suppress error messages for certain objects. There are 4 points (Process Steps) where this can occur: Recording, Transfer to…

Performing a Playback

Administrators Guide » Performing a Playback

Overview The playback process can be run in approximately the same time as the recording phase. However, this time can be reduced dependent upon the amount of bots you have available as well as the size of the target system(s) you are playing back into. The…

Notifications

Administrators Guide » Notifications

Overview It is possible to configure Testimony so that certain activities or events automatically notify one or more users as a one-off notification or on a regular basis during a particular activity. Process Steps To setup the notifications three steps are…

Product Overview

Testimony is a one of a kind, digital regression test generation and execution product developed by Basis Technologies. It is installed on and operates within the SAP ABAP stack and is particularly used to reduce the duration and cost of regression testing SAP…

Start Playback

Administrators Guide » Performing a Playback » Start Playback

Overview Once the execution queue is built from the repository, the target system is prepared and the Bots are started, the execution queue can be started Process Steps Select Test Plan to use Navigate to the Execution Queue Select Standard Scripts or Filtered…

Test Plans

Product Screens / Functions » Configuration Functions » Test Plans

Purpose This screen provides a list of all Test Plans that have been setup in this controlling system, and enables the users to maintain their settings, create a new Test Plan or mark one as the current Test Plan. Audience / Users Testimony Administrators Possible…

Building the Execution Queue

Administrators Guide » Building the Execution Queue

Overview The test scripts that have been created in the test repository must be transferred to the execution queue in preparation for the playback process. For a given Test Plan, only a single active execution queue can exist. Historical execution queues can also be…

Execution Queue

Product Screens / Functions » Execution Functions » Execution Queue

Purpose For a given Test Plan, only a single active execution queue can exist. Historical execution queues can also be seen here. Please select an execution queue to view the items contained within it, along with their current technical status information. Audience /…

Number Ranges

Product Screens / Functions » Configuration Functions » Number Ranges

Purpose Number ranges are used throughout Testimony to uniquely identify internal configuration or transactional data as it is processed in the system. Number ranges are automatically initialized but from within this screen users can monitor them. Audience /…

Standard Recordings

Product Screens / Functions » Recording Functions » Standard Recordings

Purpose Business transactions are created during the recording stage of a Test Plan phase and represent the individual “interactions” that have occurred. Please select a source system to view the transactions that have been created. Audience / Users All…

Testimony User Roles

Administrators Guide » Security » Testimony User Roles

*Note the user roles are assigned and maintained in Testimony rather than with standard SAP Roles, however, users will require the transaction /BTI/AUT in their standard SAP authorisations to access Testimony. Within Testimony, users are considered to be…