Item 5

Improve Status and Standing of Test Specification

Moore: Tests are written by Project Managers and have evolved to include the following sections. Further notes/comments are given below.

• Title
• Special Instructions
• Description
• Evaluation
• List of Actors Involved
• Test Steps

Further notes and comments

1. Connectathon tests are not published by the sponsors or domains. A simple policy on publishing the tests would allow Project Managers to collaborate with Committee Members and other interested parties in improving the documentation.
2. Many tests have answers that are "obvious" to the trained reader. The Evaluation section would benefit by having more explicit instructions on what should be examined. Some examination is a manual process by a human observer; other evaluation can be automated.
3. Project Managers attempt to publish Connectathon test plans at least 30 days in advance of the Connectathon. When that publication date is missed, effective review is difficult. Need to standardize a schedule for publishing new tests (new profiles or just new tests), review if new/existing tests and final publication in advance of the Connectathon.