Test Template
Clicking on the Generate Test Template and the test template will be automatically generated. For a new test template, it will create Test Case worksheets and a Test Run worksheet separately. A test file can include multiple test case worksheets and multiple test run worksheets.
Test Case
There are Function Point and Case sections in the Test Case worksheet.
Function Point
The function point section will store the function point information which comes from the model workbook. Only the fields highlighted in Green need to input manually when needed.
Function Point for Java Test Case
For the Java API test case, you can define the function point label in cell B18. It will be one of the case filtering criteria when executing the test case.
Function Point for REST Test Case
For the REST API test case, you can also define the API login information if the security was enabled for the tested REST API.
Case
Except for the Case and Test Result Status, other sections are generated by function point input or out output definition.
The data type for input or output columns will be specified according to the settings in Data Dictionary. Otherwise, they will be treated as String by default. The data type of test result is Boolean.
Section Name | Dynamic Columns | Description |
---|---|---|
Case | No | Case ID - Function point name with sequence number. For example, Get_Customer_Rest_001 Case Label - Custom label for filtering when executing the case Description - Case description By default, there would be 10 cases being generated. If there is a need to define more cases, use the Append Test Case feature from the AlchemyJ menu. |
Input | Yes | Columns are auto-generated by input parameters of the function point. The default value is the Example Value defined in Function Input Parameters section of the model workbook. |
Studio Expected Result | Yes | Columns are auto-generated by defined Return Data Address of the function point. The expected result can be copied from the studio test result by using the Copy Test Result to Empty Expected Result feature when building the test file for the first time. |
Studio Test Result | Yes | Columns are the same as Studio Expected Result. It contains the test result when running the test case in AlchemyJ Studio. |
Studio Test Result Match | Yes | Columns are the same as Studio Expected Result. It uses the formula to check whether the test results are matched with the expected result for each column. True or False will be returned. In some cases, it is difficult to define the expected value. For example, a dynamic ID generated by the system or current date-time. Then you could remove the formula in the cell to skip the checks for such data. |
Studio Test Result Status | No | It will show 'Passed' when all studio test result is TRUE. Otherwise, it will be 'Failed'. |
API Expected Result (If different from Studio) | Yes | Columns are the same as Studio Expected Result. The expected result can be copied from the studio test result by using the Copy Test Result to Empty Expected Result feature when building the test file for the first time. Modify the test result if different from Studio. |
API Test Result | Yes | Columns are the same as Studio Expected Result. It contains the test result when running the test case in API. |
API Test Result Match | Yes | Columns are the same as Studio Expected Result. It uses the formula to check whether the test results are matched with the expected result for each column. True or False will be returned. In some cases, it is difficult to define the expected value. For example, a dynamic ID generated by the system or current date-time. Then you could remove the formula in the cell to skip the checks for such data. |
API Test Result Status | No | It will show 'Passed' when all API test result is TRUE. Otherwise, it will be 'Failed' |
Test Run
Test Case Criteria, Test Execution Summary and Test Result sections are included in the Test Run worksheet. Use Add Test Run in the testing workbook and you can get the additional test run worksheet. Thereafter, you can define the different case criteria in different test run worksheets.
Test Case Criteria
Specify the test case is run on AlchemyJ Studio or run on API or both. When Execute Test Case from Alchemy J Menu, only the test cases that match the test criteria will be executed. All test cases will be executed on AlchemyJ Studio if no value is inputted in the test case criteria. Use semicolon ';' if there is a need to filter the cases by multiple values. For example, Case001;Case002.
Field | Support Multiple Value | Description |
---|---|---|
Run On | No | AlchemyJ Studio or API. Default value is AclchemyJ Studio. When you need to run test cases on API, the API needs to be generated before execution. |
Package Sheet Name | No | ##JavaApiPackage or ##RestApi. When the test package is REST API, the REST service needs to be started before execution. |
Endpoint Group / Class Name | Yes | Class Name of the function point. All cases will be run. |
Function Point | Yes | Name of the function point. |
Function Point Label | Yes | Function point label defined in the Test Case worksheet. |
Case ID | Yes | Test case ID defined in the Test Case worksheet. |
Case Label | Yes | Test case label defined in the Test Case worksheet. |
Test Execution Summary
Show the testing result summary and the test case running duration. You can view the overall testing result in this section.
Test Result
Show the test execution result and duration for each test case.