Testing Methodology

Data Analysis

The data monitoring and analysis process performed by eCOGRA consists of four levels of assurance that are required to be demonstrated and successfully completed to provide enough comfort that games are operated in an independent, fair and random manner. The four levels of assurance are:

1. Assurance Level 1 – Ensure reliance can be placed on the internal control environment in which the software is developed and changes are affected.

   Assurance Level 1 is concerned with ensuring that the internal control environment within which the gambling software is developed, implemented and maintained is continuously operated in a safe, secure and reliable manner, and in accordance with best practice. It aims to establish the level of reliance and comfort that can be placed on the output (gameplay results) that is generated by the gambling software.

   Assurance is achieved by subjecting the internal control environment of the gambling software provider to rigorous independent, annual, risk-based audits that focus on the adequacy of controls within the information security, business continuity and disaster recovery, change control and software development areas.

   The formal audit process is based on comprehensive work programs to ensure the work is consistently performed and documented in accordance with the relevant eGAP requirements. Findings are reported to the software provider’s senior management, and 100% compliance is required in all areas before final submission to eCOGRA’s Seals Compliance Committee for approval.

2. Assurance Level 2 - Ensure that the data produced by the software has not been manipulated or corrupted.

   Assurance Level 2 is concerned with verifying that the data produced by the gambling software was not manipulated or corrupted in any way before being displayed to the player, and that all the data produced by the gambling software has been received by eCOGRA for analysis.

   Assurance is achieved by subjecting the gambling and financial data generated by the gambling software to rigorous, independent, risk-based assessments such as trend analysis that focus on the integrity, completeness and consistency of the data.

   Further comfort is achieved by ensuring a complete set of data was obtained by performing financial reconciliations between independent sources, and any resulting discrepancies would indicate possible tampering.

   The correctness of financial data used in reconciliations is verified on a monthly basis during the completion of payout percentage reviews. Payout percentage reports are issued monthly to eCOGRA operators if all financial data reconciles.

   Random number generator assessments are based on a formal RNG methodology and involves various recognised statistical tests that are performed on the gambling data.

   For random number generator reports to be issued all financial data must reconcile and RNG tests performed must fall within the accepted ranges required for a pass.

3. Assurance Level 3 – Ensure that reports published on the gambling websites have not been tampered with.

   Assurance Level 3 involves ensuring that once payout percentage and random number generator reports are issued, the published results cannot be manipulated.

   Assurance is achieved through eCOGRA centrally controlling the publishing of reports on the relevant websites, preventing possible tampering of data before and after final publishing.

   Further comfort to this process is achieved by reviewing published reports on a regular basis during the operator eGAP reviews.

4. Assurance Level 4 – Ensure complete quality and independence of the process

   Assurance Level 4 is a fundamental component necessary to validate the overall quality and correctness of the data analysis process and approach followed at each assurance level. eCOGRA’s governance structure allows for complete quality control and independent assessment through the annual ISO 17025 inspection performed by the United Kingdom Accreditation Service.