Use Case: Kenya Covid-19 Whatsapp eLearning
- Rodolfo Melia
As of early December 2020, Kenya has documented over 80,000 COVID-19 cases, with approximately 1,500 deaths. The COVID-19 pandemic presented significant challenges to the health system, particularly concerning upskilling health workers on how to respond to the new disease. The government response had been primarily focused on ensuring that the public sector was well prepared to curtail the spread of the pandemic. However, given that about 50% of Kenyans seek health care in the private sector, it was critical to ensure that health providers were also well prepared to manage COVID-19. Population Services Kenya (PS Kenya) and Population Services International (PSI) partnered to take on the challenge of upskilling private sector health workers, with support from Unilever and UKAID through the HBCC Unilever Project a 500M GBP investment which aims to reach over 500 million individuals across 37 countries with critical messages, services, and products to prevent the spread of COVID-19.
 |  |
In pre-pandemic times, PS Kenya and PSI often provided in-person training for healthcare workers to update their skills in delivering health services. However, in a world of physical distancing, they had to rethink this model. Working closely with the Ministry of Health, they designed and implemented a remote capacity-building solution using existing digital platforms to deliver certified COVID-19 training to over 1,000 private sector health workers. This solution presents an excellent opportunity to address the current skills gap associated with COVID-19 but also offers a cost-effective path to broaden the support of health providers at scale.
A FAMILIAR REMOTE LEARNING ENVIRONMENT
Internet penetration currently stands at 87% in Kenya, with two-thirds of users connecting via smartphones. Nine out of 10 mobile internet users in Kenya have WhatsApp (including the majority of the 3,000 private sector health providers affiliated with PS Kenya); hence using WhatsApp was considered an appropriate channel to deliver COVID-19-related remote capacity building, targeted at private sector providers more broadly. To automate the interactive learning experience, they adapted the official Ministry of Health COVID-19 training curriculum to run the e-learning chatbot application tailored for WhatsApp, to deliver a learning experience through a channel familiar to the target audience. The training was packaged into discrete modules focused on COVID-19 Epidemiology, Infection Prevention & Control, Occupational Health & Safety, and Case Management. Emphasis was placed on training regarding preventive measures to protect health workers and their clients. The training was delivered in a manner that allowed providers to learn at their own pace, interact with audio and visual content, and access online links for further reading. No orientation is required to use the platform—simply ‘click’ and trainScreenshotot of the COVID-19 e-Learning Chatbot course.
The course included six modules with pre and post-test quizzes.
Module 1: COVID-19 Introduction and Background,
Module 2: Introduction to COVID-19 Vaccines,
Module 3: COVID-19 Vaccines in Kenya,
Module 4: COVID-19 Vaccine Safety,
Module 5: COVID-19 Information, Education and Communication,
Module 6: Common Myths and Frequently Asked Questions on COVID-19 Vaccination
TARGET AUDIENCE REACH
The WhatsApp-based remote learning solution was launched in August 2020, with the clickable link to join the WhatsApp platform mainly distributed to private clinics and pharmacy staff affiliated with PS Kenya through WhatsApp groups. At the end of November 2020, approximately 2,500 private sector providers had accessed the platform to embark on training, with over 1,000 providers completing the full COVID-19 curriculum, thus receiving a certificate and recognized contribution towards their Continuing Professional Development (CPD) learning hours from the Ministry of Health. Many providers continue to undertake the training. Regarding the profile of the providers accessing the platform, they were equally split in gender, with 80% of them aged between 20-39 years. Eight out of 10 providers were either Clinical Officers or Nurses, with the rest consisting of medical doctors, laboratory staff, facility managers, and pharmacy staff.
PROVIDER KNOWLEDGE IMPROVEMENT
To measure the knowledge improvement associated with the training, providers undertook a pre-test within the platform to determine their base level of knowledge on COVID-19 before interacting with the learning material. Once completed, they completed a post-test to establish improvement in knowledge from baseline. There was a significant improvement in provider performance following the training, with 5 out of 10 providers scoring above 80% following the learning as opposed to 1 out of 10 before completing the course. PSKenya continues to look into ways to further strengthen providers' performance based on their insights and experiences with the app.
“IT’S THE WAY TO GO FOR NOW, AS IT IS EASY AND CONVENIENT”
The WhatsApp learning platform also gathered feedback on user experience. We additionally gathered qualitative insights from a sample of the providers. Feedback on the learning experience has been overwhelmingly positive. Given that ‘time is money’ for these providers working in the private sector, they appreciated the flexible and convenient approach to learning using WhatsApp. One provider expressed: “The platform enables me to learn as I work, unlike other training modalities where we have to leave our facilities for a week and go to learn.” The availability of the course on WhatsApp, a platform providers regularly use to connect socially, also contributes to the ease of use— a provider noted, “I use WhatsApp for my social communications; it’s easy to learn as you chat with your friends too.”
Based on platform-generated feedback from approximately 250 providers who completed the curriculum, both the training content and learning approach using WhatsApp were well received. Nine out of 10 providers offering feedback reported that the training content either met or exceeded their expectations. As per the illustration below, the majority of our providers highly rated the learning approach using WhatsApp. Providers noted an interest in further learning using this approach, particularly on Sexual and Reproductive Health, HIV/TB, Non-communicable diseases, and Maternal & Child Health. In addition, providers appreciated using videos, expressing the need for more video-based content to be incorporated into future learning. The main area of improvement cited by providers was regarding the issuing of the certificate, which they felt should have been automated at the end of the training rather than sent at a later date. Some providers also noted that providing data bundles would have also been an excellent incentive to drive participation.
A COST-EFFECTIVE PATHWAY TO HEALTH PROVIDER STEWARDSHIP AND SUPPORT AT SCALE?
Using in-person training as a comparator, we undertook a crude comparative analysis to establish the cost-effectiveness of the WhatsApp learning approach (see illustration). The WhatsApp learning approach presents a more cost-effective approach compared to in-person training, even when including the platform set-up costs. This is due to the high accommodation, per diem, and conferencing costs associated with in-person training. The cost-effectiveness further improves once the platform set-up costs have been accounted for. The cost of training each additional provider reduces to approximately $7 for the next 1,000 providers, accounting for WhatsApp transaction costs as well as project management and technical support.
FORWARD LOOK
Given the positive feedback from providers regarding the learning approach and cost-effectiveness, there are plans underway to cascade the training to public sector workers, taking a mixed health system strengthening approach. In addition, PS Kenya and PSI are considering broader use of this approach to scale stewardship and support across the universe of private sector providers in Kenya and beyond, working in partnership with governments and other stakeholders with a vested interest. This will go beyond COVID-19-related support, catering to all the capacity-building needs of providers to strengthen Primary Health Care delivery. They will continue to enhance the platform based on user insights, furthermore, undertake further analysis on cost-effectiveness to ground the approach. If successful, health providers will have more control of their personal development, as they will be a ‘click’ away from the required support.