Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Info

Use of Program Rules vs Program Indicators

All scores are implemented as Program Rules, rather than as Program Indicators.

The rationale is simple: as assessment lists evolved over time, questions are added and removed, and their weight could change. We do not want to change a historical value, which was calculated based on the questions present at the time of a given evaluation. Hence we use Program Rules to store the calculated values at the time of the evaluation. These values are stored on dedicated DEs that are created as part of the list set-up.

Assessment scores in HNQIS are calculated using a weighted arithmetic mean of all the answered questions grouped by Composite Indicators (Also referred to as Feedback Orders).

The basic formula for the score in the following section:

The formula is applied for every score and its nested sub-scores. To explain this further let's create Assessment Tree illustration below ‘Exmaple 1’ shows the structure of an example a H2 Checklist, which includes the Scores, Sub-scores and their retrospective questions.

...

In H2 you're able to nest scores inside other scores as well as combine those nested scores. Image Added

Scoring follows a hierarchy based on how the Assessment is structured, the most important part here is that score Score formulas are defined from the lowest level of the hierarchy to the top (from the innermost part of the Assessment Tree to the exterior).

Info

Assessment Tree

Name of the structure of the Assessment, it's called Tree because the branching structure resembles a tree.

As shown in the illustration above ‘Example 1 H2’1’, the first score 'Score' formulas that will be defined are;

  • Score 1.1

...

  • Score 1.2

...

  • Score 2.1

...

  • Score 3

...

Also, every score is split into two parts: Numerator and Denominator. This is due to the following reason.

In HNQIS, ‘Scores’ are divided into ‘Sub-scores’, however, ‘Sub-scores’ are not used to calculate the ‘Scores’, for example, scores 1.1 + 1.2 would not define score 1.

‘Scores’ are calculated from the results of the ‘Q' questions within ‘Sub-scores’, not the 'Sub-score’ themselves.

...

This is the reason why every score is split between Numerator and Denominator so that those values can be re-used in the Scoring Formulas of all the ‘Scores’.

Use of Program Rules vs Program Indicators

All scores are implemented as Program Rules, rather than as Program Indicators.

The rationale is simple: as assessment lists evolved over time, questions are added and removed, and their weight could change. We do not want to change a historical value, which was calculated based on the questions present at the time of a given evaluation. Hence we use Program Rules to store the calculated values at the time of the evaluation. These values are stored on dedicated DEs that are created as part of the list set-up.

...

Calculating a Score Containing Only Questions

...

In this example, we will assume that every question is all questions are ‘Critical’

Score 1.1 which contains questions Q1, Q2 and Q3 would have the following set of formulas:

...

Note

Please note you should give consideration is that this the following formula only includes Critical Questions (while the other ones included both Critical and Non-Critical questions).

...

Now, using the formula defined in the previous section,the Assessment Score of this example ends up being:

...

The formula for the Assessment Score in this example ended up including all the questions in the checklist due to the assumption made at the beginning of this section where we stated all questions were all ‘Critical’.

As another example, if the only Critical Questions were Q1, Q2, Q3, Q8 and Q9; the Assessment Score formula would be the followingas follows:

...

This is what the last Below you see how the final equation looks like for DHIS2:

...

Calculating the Critical and Non-critical Scores

PreviouslyAs previously stated, all questions in our examples are classed as 'Critical, a special condition was presented to demonstrate the Assessment Score calculation. This condition was to assume that every question in the assessment was Critical, but in most cases, HNQIS Checklists contain a combination of Critical and Non-critical questions.

Define Scores and defined critical scores

Info

Please Note: The Assessment Score will always be defined by the Critical Score unless the Assesment does not contain any Critical Questions.

The formula will always return an Assessment Score, even if it is not required for the Assessment, it is required for the Competency Class Calculation. In the event there are no Critical Questions in the Assessment. In the case , the formular will fall back to the non-critical scores.

In the event that there are no Critical Questions in an Assessment, the Assessment Score will be defined by the Non-critical Score. Even , even if the Non-critical score is not always needed required for the Assessment Score calculation, it's still used required for the Competency Class Calculation.

...