Test Case Submission and FAQ
If a test cycle contains test cases to be completed, you will first need to claim them from the test case library. To do so, accept the test cycle agreement and proceed to "My Test Cases." On this screen, you will be presented with the test cases associated with this particular test cycle. Under "Available Test Cases," you can view which test cases are available for you to claim based on your testing environment and predetermined rules set by the customer (e.g. limited number of testers per environment, limited number of pending test cases per tester). If a test case is available for you to claim, you will see a "Claim" button under the 'Action' column; if unavailable, you will see "Not Claimable" instead. To preview each test case, click on the test case name. To claim an available test case, click on the 'Claim' button to the right of each test case. When you claim a test case, you will need to select the testing environments you are able to test against. Only claim one testing environment per test case unless otherwise noted under 'Scope and Instructions'.
Remember, you may not claim any test cases once you have reached the predetermined limit per tester and/or the limit of pending test cases per tester (this limit is based on the test case level, as opposed to the test case and testing environment combination level). Once you have completed one or more test cases, check back under "My Test Cases" to see if you're eligible to claim more test cases. Additionally, you can still claim test cases if the test cycle is in the locked status, but you cannot submit results unless the test cycle reactivates. When you are ready to begin executing the test case, please click on the "Start" button of the relevant test case. You then have the ability to click Pass/Fail next to each step until all steps have been completed. If you are unable to complete the steps, you may click the "Submit" button and select a reason (e.g. invalid test case, unable to complete). Doing so will result in a "Skipped" test case, and no payments will be issued. After you have submitted your test case, you may click on 'My Test Cases' at any time to view the status of your submitted test case (approved/rejected).
- What does the Action column status 'No Environment Matches Remain' mean?
This means that all available test cases have been claimed in this test cycle. If this is the case, check to see if the test cycle is 'Exploratory with test cases' in which case you can use the URL to report bugs as opposed to submitting a test case.
- How many test cases can I claim?
- Only accept one testing environment per test case unless otherwise noted. Additionally, there is a limited number of pending test cases you can claim across all of the test cycles you're currently participating in.
- What if a test case step fails?
- If one or more steps fail, complete the remaining steps and submit when all steps have been marked pass or fail. Additionally, you have the option of filing a bug report (dropdown menu on the Fail button). Finally, the submitted test case will be marked Fail
- Can I change the status of my submitted test case (from pass to fail or vice versa)?
- Yes. If you need to revise the pass/fail status of one or more test case steps, click on your submitted test case to find the "Undo Submission" link (next to the Discard button). When you click on this link, you will be able to change the pass/fail status for each step by clicking on the "X" next to the Passed/Failed image. After you make changes to relevant test case steps, click on the Submit button to commit to your changes and put your test case back in Pending Approval Status.
- Can I attach a file to my test case?
- You may upload it to your test case under "Result Attachments" in the test case itself.
- Can I discard or unclaim an entire test case result?
- Yes. To unclaim a test case, click on the test case in question. Next, click on the "Unable to complete" link to the left of the Start button. Finally, select "Unclaim" option to permanently unclaim and discard your test case. Please note that you will not be able to retrieve your test case once you have discarded it.
- Why does my test case have a status of STARTED or CLOSED?
- If you claim and begin a test case while the test cycle is still active or locked, the test case status will be labeled STARTED. If you do not complete the test case before the test cycle closes, the test case status will then be labeled CLOSED.
