The data quality assessment, based on WHO's data quality review toolkit, indicated high-quality data generated from the solution for all the metrics, namely: completeness (100%), timeliness (91,66%) and internal/external consistency (100%). Moreover, the ratio of the data recording error was low in the study, ranging from 0.05% to 1.7%.
A time efficiency evaluation, assessing how much time health workers spend on administrative tasks during and after delivery of care with Smart Paper Technology compared to the existing Health Management Information (HMIS) tools, showed that around 64% to 96% of time could be reduced in different stages of data administration.
A cost analysis comparing operational costs of the Smart Paper Technology (SPT) Solution and the existing HMIS forms concluded that, when factoring the value of reduced administration, the SPT Solution cost 316,436 USD (0.228 USD per child) which is less expensive than the cost of printing the existing HMIS forms which cost 873,253 USD (0.630 USD per child). When the administration time was excluded from the analysis, the SPT Solution (206,126 USD) was more expensive than HMIS forms (195,581 USD). However, it is noteworthy that the SPT Solution was only 5% more expensive than the current HMIS when excluding administration costs.
The results of the evaluation regarding the transfer of work processes to the existing health system, which is one of the key success metrics to evaluate sustainability of the programme and how well it can be managed by the local stakeholders in Afghanistan, indicated that 95% of the processes essential to the management of Smart Paper Technology had been transferred to the local stakeholders in Mehterlam District. In most cases, these processes have been transferred in a way that is both accurate and sustainable. The remaining processes are planned to be fully transferred by the end of 2018.