Test run statuses

Every test run moves through a lifecycle. A run starts as pending and ends in one of four terminal states.

Status	Meaning
pending	The run is queued or actively running on a device.
success	The test passed — the app did what the test described.
failure	The test ran to completion but the expected outcome wasn’t met.
error	The run couldn’t complete (e.g. the build wouldn’t install or launch).
cancelled	The run was cancelled before it finished.

Notes

• There is one run per test, per build — the latest run for a given test and build is the one that counts.
• A pending run that has been assigned to a cluster is actively running.
• failure means the app behaved, just not as expected. error means Semaloop couldn’t get far enough to judge — these usually point at build or environment problems rather than your test.