Testing · piloting · independent review
Test Rig and validation
FASO is already piloting the system. Testing and practical experience inform its development; independent validation must separately examine the technical claims and the proposed organisation.
The Test Rig
Check the system. Record the evidence. Learn from faults.
The Test Rig is FASO’s internal testing environment. It checks whether the system performs its intended functions and provides evidence for review and improvement.
Repeatable checks
Repeat testing under defined conditions so results can be examined and compared.
Clear records
Keep an account of what was tested, what happened and any limitations.
Learning from faults
Record problems, investigate them and check that corrections address the failure.
System piloting
Learn from use within a defined scope.
- Examine reliability and practical usefulness
- Identify operating demands and issues that need attention
- Use experience to guide improvements and further testing
- Keep conclusions within the scope of the pilot
Independent system validation
Put the technical claims to external challenge.
- Use independently agreed review criteria
- Examine the strength and limits of the evidence
- Allow reviewers to confirm, qualify or reject claims
- Keep the external conclusion independent of FASO
Institutional validation
Test the organisation’s ability to hold its responsibilities.
- Compare legal and governance options
- Test responsibility, conflicts and funding independence
- Examine protection of the public-interest purpose
- Allow the proposed organisational model to be challenged or rejected
Future governance pilot
Exercise the proposed institution’s decisions in practice.
A governance pilot would test responsibilities, conflicts, publication decisions and incident handling. It is distinct from piloting the technical system.
Explore institutional validationProposed independent process
Reviewers must be free to reach their own conclusion.
The proposed independent review should build on evidence from testing and piloting while retaining control of its own assessment and report.
Define what will be assessed, the evidence required and the criteria before the review begins.
Examine reliability, limitations and alternative explanations under appropriate information protections.
The external reviewers control their findings, qualifications and final report.
Follow the programme
See the technical position and the opportunities for review.
The current technical status is maintained on How FASO works. Reviewers can help challenge the evidence and identify what needs further examination.