RDQA Technical Manual: Program Indicators

Overall Data Quality Score

Average of the Data Verification and System Assessment scores

Result:

We don't have a way to export this macro.

Overall Data Quality Score = (Part 1 + Part 2) / (1 + Do you want to do an M&E assessment?)

Part 1

We don't have a way to export this macro.

(
  (
    (Source vs. Donor or MIS (%variation)
    + Source vs. Summary (%variation)
    + Summary Report vs. Donor or MIS (%variation)) / 3
  ) +

+ (% of available source documents)

+ (% of completed source documents)

+ (Confidentiality: Client data is protected * 100)

+ (Integrity: Are there unauthorised changes? * 100)

+ (Precision: Data has sufficient detail * 100)

+ (% of reports received on time)
) / 7

Part 2

We don't have a way to export this macro.

(
  (
    (d2:zing(1.1 Staff explained indicator correctly)
    + d2:zing(1.2 Standard reporting tools for services)
    + d2:zing(1.3 Standard reporting tools for stock)
    + d2:zing(1.4 Tool guidance available)
    + d2:zing(1.5 Documented review of site level reports)
    + d2:zing(1.6 Staff explains data checks correctly)
    + d2:zing(1.7 Documented reporting guidelines)
    + d2:zing(1.8 Documented feedback to site of reports)
    + d2:zing(1.9 Staff explain data use correctly)
    + d2:zing(1.10 Documented data handling guidance)
    + d2:zing(1.11 Documented quality controls in place)
    + d2:zing(1.12 Adequate and sufficient filing system)
    + d2:zing(2.1 Paper to digital entry quality control)
    + d2:zing(2.2 Digital 1st data entry quality control)
    + d2:zing(2.3 Passwords in place)
    + d2:zing(2.4 Systems back ups in place)
    + d2:zing(2.5 Documented stock management guidance)
    )
    /
    d2:zpvc(
      1.1 Staff explained indicator correctly,
      1.2 Standard reporting tools for services,
      1.3 Standard reporting tools for stock,
      1.4 Tool guidance available,
      1.5 Documented review of site level reports,
      1.6 Staff explains data checks correctly,
      1.7 Documented reporting guidelines,
      1.8 Documented feedback to site of reports,
      1.9 Staff explain data use correctly,
      1.10 Documented data handling guidance,
      1.11 Documented quality controls in place,
      1.12 Adequate and sufficient filing system,
      2.1 Paper to digital entry quality control,
      2.2 Digital 1st data entry quality control,
      2.3 Passwords in place,
      2.4 Systems back ups in place,
      2.5 Documented stock management guidance
    )
  ) * 100
)

Functions:

d2:zing: Evaluates the argument of type number to zero if the value is negative, otherwise to the value itself.
d2:zpvc: Returns the number of numeric zero and positive values among the given object arguments. Can be provided with any number of arguments.

System Assessment Score

The system assessment checklist enables the qualitative assessment of the strengths and weaknesses of the functional areas of the data management and reporting system. While is it recommended that both parts of this tool (Data Verification and System Assessment) be used to fully assess data quality, the system assessment component could be conducted less often. This can be done during the initial assessment (baseline) and can be triggered when the site scores low on the data verification component.

Final Result:

We don't have a way to export this macro.

System Assessment Score  = 
(
  (
    Part 1 / Part 2
  ) * 100

Part 1:

   d2:zing(1.1 Staff explained indicator correctly)
    + d2:zing(1.2 Standard reporting tools for services)
    + d2:zing(1.3 Standard reporting tools for stock)
    + d2:zing(1.4 Tool guidance available)
    + d2:zing(1.5 Documented review of site level reports)
    + d2:zing(1.6 Staff explains data checks correctly)
    + d2:zing(1.7 Documented reporting guidelines)
    + d2:zing(1.8 Documented feedback to site of reports)
    + d2:zing(1.9 Staff explain data use correctly)
    + d2:zing(1.10 Documented data handling guidance)
    + d2:zing(1.11 Documented quality controls in place)
    + d2:zing(1.12 Adequate and sufficient filing system)
    + d2:zing(2.1 Paper to digital entry quality control)
    + d2:zing(2.2 Digital 1st data entry quality control)
    + d2:zing(2.3 Passwords in place)
    + d2:zing(2.4 Systems back ups in place)
    + d2:zing(2.5 Documented stock management guidance)

Part 2:

d2:zpvc(
      1.1 Staff explained indicator correctly,
      1.2 Standard reporting tools for services,
      1.3 Standard reporting tools for stock,
      1.4 Tool guidance available,
      1.5 Documented review of site level reports,
      1.6 Staff explains data checks correctly,
      1.7 Documented reporting guidelines,
      1.8 Documented feedback to site of reports,
      1.9 Staff explain data use correctly,
      1.10 Documented data handling guidance,
      1.11 Documented quality controls in place,
      1.12 Adequate and sufficient filing system,
      2.1 Paper to digital entry quality control,
      2.2 Digital 1st data entry quality control,
      2.3 Passwords in place,
      2.4 Systems back ups in place,
      2.5 Documented stock management guidance
    )

Functions:

d2:zing: Evaluates the argument of type number to zero if the value is negative, otherwise to the value itself.
d2:zpvc: Returns the number of numeric zero and positive values among the given object arguments. Can be provided with any number of arguments.

Overall Data Verification Score

This section facilitates the assessment of the quality of data for the selected indicator. It involves the review of documents based on the data quality dimensions i.e. accuracy, completeness, etc.

We don't have a way to export this macro.

Overall Data Verification Score  =
(
  (
    (
      Source vs. Donor or MIS (%variation)
      + Source vs. Summary (%variation)
      + Summary Report vs. Donor or MIS (%variation)
    ) / 3
    + % of available source documents
    + % of completed source documents
    + Confidentiality: Client data is protected * 100
    + Integrity: Are there unauthorised changes? * 100
    + Precision: Data has sufficient detail * 100
    + % of reports received on time
  ) / 7
)

Availability

The extent to which data and its supporting documentation are available.
Review availability of the indicator source documents for the selected reporting period.
Source documents depend on the indicator but will often refer to client intake forms, registers, cards redeemed vouchers, etc.

We don't have a way to export this macro.

% of available source documents

Completeness

We don't have a way to export this macro.

% of completed source documents

Timeliness

We don't have a way to export this macro.

% of reports received on time

Integrity

We don't have a way to export this macro.

Integrity: Are there unauthorised changes? * 100

Confidentiality

We don't have a way to export this macro.

Confidentiality: Client data is protected * 100

Precision

We don't have a way to export this macro.

Precision: Data has sufficient detail * 100

Accuracy

We don't have a way to export this macro.

(Source vs. Summary (%variation)
+ Source vs. Donor or MIS (%variation)
+ Summary Report vs. Donor or MIS (%variation)) / Value count

Source vs. Summary

We don't have a way to export this macro.

Source vs. Summary (%variation)

Source vs. MIS or donor

We don't have a way to export this macro.

Source vs. Donor or MIS (%variation)

Summary vs. MIS or donor

We don't have a way to export this macro.

Summary Report vs. Donor or MIS (%variation)

Number of Assessments conducted

We don't have a way to export this macro.

Enrollment count