Applied Methodology for Evaluation of Telecenter Networks

1.0 INTRODUCTION
Sustainability Index (SI) is a new methodology designed to evaluate the performance and sustainability of a heterogeneous Telecenter Networks. This methodology designed through research and development to assist in an M & E process done by e fusion private ltd, on an assignment given by Information and Communications Technology Agency (ICTA) to improve the sustainability of Nenasala Telecenter Network in Uva province, which had faced critical sustainability issues.



The Uva province is situated south east of Sri Lanka, (see figure 2.0) challenged with transportation, communications, and highest poverty. The 60 Nenasala are distributed across region. “Nenasala in Uva are quite common in infrastructure but unique by location, ownership and technology skills and the community they serve has a special significance in their uniqueness.” (Niranjan M, Impact Monitoring & Evaluation for Developing of Sustainable Tele Center Networks, 2009)

2.0 MATERIAL AND METHODS
The objective of SI was to provide a unique performance indicator for each Telecenter, Zone, District and Region to monitor and asses the changes resulted from the network development process implemented by the M & E Team. The research model designed took the network it self as the base learning model to monitor and capture periodic data on performance to understand issues and initiate collaborative network action based on shared strategies developed with evaluated community.

2.1 SUSTAINABILITY INDEX
Sustainability Index (SI) describes 10 levels Telecenter capacity of sustainability assessed from monitoring data. Based on learning from sustainable Telecenters A SI of 6 is targeted as minimal proof of Telecenter Sustainability.

SI - Description
1 - Telecenter is operational
2 - Has Management Capacity
3 - Telecenter Communicates
4 - Has Technology Skills
5 - Initiates Social Change
6 - Reached Financial Sustainability
7 - Takes Zonal Network Leadership
8 - Takes Regional Network leadership
9 - National Network leadership
10 - Global Network leadership

2.2 ASSESING SUSTAINABILITY

Sustainability Index for each Telecenter derived by monitoring sub characteristics of five key areas of Network participation, content and services, service quality, quantity served and revenue generated. Number of workshops participated, collaboration with network members, technology skills, management, service quality, number of users, community involvement, revenue and costs were some sensitive characteristics measured to asses the financial and social sustainability of Telecenter and forming Network.

3.0 ANALYSIS


Figure 4.0

During the period of 1 Year Uva Nenasala Network SI grew from 2.8 to 5.1 (figure 4.0) and the poor performing Nenasala reduced from 32.5% to 18.3%. This resulted from many Nenasala becoming operational with Shilpa Sayura e learning deployment.Talakumbura, Thanamalwila, Siyambalanduwa and Girandurukotte Nenasala used e learning effectively improve their social sustainability and financial profitability.

Talakumbura Nenasala which was not operational at the beginning grew to SI of 7.0. is resulted from Technical, management, leadership training, deployment of Shilpa Sayura e Learning and involvement of the community which lead to improving financial profitability. Haldumullla Nenasala with M & E process developed as a National network leader obtained SI of 9.0.

At the same time Olagangala, Perahettiya, Kabillegama stayed at SI of 1.0 due to poor performance, lack of management and network participation. The SI was found to be much sensitive to availability of a capable Nenasala operator. The continuation of the same operator for a longer period improved Nenasala with M & E and effected performance when they leave. This situation improved by training a second row of operators. The Technology training on Virus care, Hardware maintenance, Sinhala Unicode and online communications, business planning, project development, Web designing and School ICT improved Telecenter as well as impact on the average network SI. The zonal leadership in Thanamalwila, Mahiyangana, Buttala, Madagama and Haliela improved the zonal SI and overall network performance.

3.1 CHALLANGES
The unavailability of Internet and poor quality services hardware services, non availability resources like Multimedia projectors, Notebooks, replacement hardware and non corporation of some Nenasala impact Network SI falling behind anticipated level of 6.0.

3.2 IMPACT OF SUSTAINABILITY INDEX



SI was a unique indicator and helped early identification of Network issues to initiate appropriate Network Actions to direct technical support, content & services, capacity building and advocacy in M & E Process as well as indicated the effectiveness of strategies and lead to process and policy changes which improved the sustainability of Uva Nenasala Network.

4.0 CONCLUSIONS
Sustainability Index is useful methodology to evaluate the results of M & E for developing of Telecenter Networks and It could be applied to study Network growth directions and requires further research to be develop an instrument to measure National Telecenter Networks sustainability.

5.0 ACKNOWLEDGEMENTS
ICTA, UVA Nenasala and E fusion RIT.

6.0 REFERENCES
1.) Meegammana N., Sampath R., “Impact Monitoring & Evaluation for Developing of Sustainable Tele Center Networks”, Sri Lanka Evaluation Association, April 2009
2) .Gómez R. and Hunt P., “Telecentre Evaluation a global perspective”, Report of an International Meeting on Telecentre Evaluation, IDRC, 1999
3.) ICTA UVA RIT Assignment Reports, 2009