THE RELATIONSHIP BETWEEN PROGRAM EVALUATION PURPOSES AND THE USE OF ITS FINDINGS IN SELECTED CHARTERED CHRISTIAN UNIVERSITIES IN KENYA
Abstract
Purpose: This is a quantitative study to examine the correlation between Program Evaluation (PE) purposes and the use of PE results in selected Chartered Christian Universities (CCUs) in Kenya.
Methodology: A census of program leaders of 50 accredited, operational and re-evaluated academic programs in three CCUs was carried out. A questionnaire was used for data collection. Correlation and logistic regression analyses were done.
Results: Correlation analysis revealed a strong, positive and significant association between accountability to funders and sponsors purpose and use of evaluation results. There was also a moderate, positive and significant association between program improvement purpose and use of evaluation results. Logistic regression analysis revealed that, sponsor and funder mandates are likely to promote the use of evaluation at Exp (B) = .024, p value = .004. The findings suggest that, when PE is done for accountability to funders and sponsors, the use of the results is likely to increase by .024 times. Logistic regression analysis also demonstrated that, motivation to improve the program is a more critical determining factor as to whether the evaluation results will be used or not (p value of .012 and Exp (B) = 12.633). This suggests that when PE is conducted for improvement, the use of the results is likely to increase by 12.633 times. PE conducted for the purpose of program improvement is the most critical purpose. It is likely to increase the use of PE results at least 12 times more than external mandates such as sponsors and funders.
Recommendations: The researcher recommends that, to foster use of evaluation results, institutions should give prominence to PE purpose, more specifically to program improvement as a reason for conducting PE.
Key Words: Program evaluation, Evaluation use, Evaluation purposes, Accreditation, Program improvement, Accountability, Quality education, Sponsors and Funders, Higher education, Christian universities
References
Bennett, J. (2003). Evaluation Methods in Research. London: Continuum.
Nyaigotti-Chacha, C. (2017). Press Statement on Quality Audit of Universities in Kenya Conducted In January And February 2017. http://host.nationmedia.com/CUE-uni.pdf.
Christina, C. & Alkin, M. (2013). An Evaluation Theory Tree - 2012 (most updated version). https://www.researchgate.net/publication/333392751_An_Evaluation_Theory_Tree_-_2012_most_updated_version.
Cloete, F. (2016). Developing an Africa-rooted programme evaluation approach Department of Public Administration and Management, University of the Free State Bloemfontein South Africa.
Babajide, C., V. (2001). Training of the Ministry: A Macro-curricular Approach. Bangalore: Theological Book Trust.
Commission for Higher Education. (2008). Handbook on Processes for Quality Assurance in Higher Education in Kenya. http://www.cue.or.ke Accessed on August 15, 2018.
Commission for University Education 2014-2018 Strategic Plan.
Eisner, E., W. (1979). The Educational Imagination: On the Design and Evaluation of School Programs. New York: MacMillan Publishing Co. Inc.
Frye, A., W. & Hemmer, Paul, A. (2013). Program Evaluation Models and Related Theories. Dundee, UK: AMEE.
Glasman, N., S. & Nevo, D. (1988). Evaluation in Decision Making: The case of school administration. (Evaluation in Education and Human Services Series.) Boston: Kluwer Academic Publishers.
Hayward, F. (2006). Quality assurance and accreditation of higher education in Africa. Paper prepared for presentation at the Conference on Higher Education Reform in Francophone Africa: Understanding the Keys of Success. June 13-15, Ouagadougou, Burkina Faso.
Inter University Council of East Africa Directory. East African Universities and Higher Education in Partnership with Inter University Council of East Africa Directory 2015/2016.
Leahy, M.J., Thielsen, V.A., Millington, M.J., Austin, B., & Fleming, A. (2009). Quality assurance and program evaluation: Terms, models, and applications. Journal of Rehabilitation Administration, 33(2), 69-82.
Malena, C., Reiner,F. & Janmejay, S. (2004). “Social Accountability: An Introduction to The Concept and Emerging Practice.” Social Development Paper 76. Washington, DC: World Bank.
Materu,P. (2007). Higher Education Quality Assurance in Sub-Saharan Africa: Status, Challenges, Opportunities, and Promising Practices. Washington, D.C: The World Bank.
McDavid J., C. Huse Irene & Ingleson L., R. L. (2013). Program Evaluation and Performance Measurement: An Introduction to Practice. 2nd Edition, Canada, SAGE Publications Inc.
Fatma, M.. (2006). A Systems Approach to Program Evaluation Model for Quality in Higher Education. In Quality Assurance in Education. Vol. 14 No. 1, Emerald Group Publishing Limited. 0968-4883 DOI 10.1108/09684880610643601.
Mukhwana, E., S. Oure, S. Kiptoo, A. Kande, R. Njue, J. Too and D.K. Some. (2016). State of University Education in Kenya. Commission for University Education. Discussion. Paper 04. Nairobi, Kenya.
Azat,. M. (2001). "A Model of Academic Program Review for Program Improvement" Master's Capstone Projects. 109. Retrieved from https://scholarworks.umass.edu/cie_capstones/109.
Myhlhousen-Leak, G., A., D. (2011). "An investigation of outcomes assessment utilization in the context of teacher education program accreditation." PhD thesis, University of Iowa. https://ir.uiowa.edu/etd/1037.
Okebukola, P. A. & Fonteyne, B. (2014). Developing a Pan-African Quality Assurance and Accreditation Framework.
Ott, B. (2017). Accreditation: Importance and Benefits for the Institution. In Leadership in Theological Education: Foundations for Academic Leadership. (184-215). Vol. 1. Editors Fritz Deininger & Orbelina Equizabal. UK: Langham.
Otunga, R. N., Odero, I. & Barasa, P., L. (2011). A Handbook for Curriculum and Instruction. Eldoret: Moi University Press.
Palomba, C., A. & Banta, T., W. (1999). Assessment Essentials: Planning, Implementing, and Improving Assessment in Higher Education, 1st ed. San Francisco: Jossey-Bass Publishers.
Sawer, B., J. (1992). Evaluating for Accountability: A Practical Guide for the Inexperienced Evaluator. Oregon State University Extension Service.
Saylor J. Galen, A., W., M. & Lewis A., J. (1981). Curriculum Planning for Better Teaching and Learning. 4th Edition. NY: Holt-Saunders International Editions.
Slimmer, V., M. (1981). "Evaluating a program in higher education: a conceptual process and its application." Retrospective Theses and Dissertations. 6854. https://lib.dr.iastate.edu/rtd/6854.
Stufflebeam, D., L. (2001). Evaluation Models. New Directions for Evaluation, no. 89, Spring 2001 © Jossey-Bass, A Publishing Unit of John Wiley & Sons, Inc. https://wmich.edu/sites/default/files/attachments/u58/2015/Evaluation_Models.pdf.
SUNY University Faculty Senate. (2012). Guide for the Evaluation of Undergraduate Programs. Undergraduate Committee. January 2012.
Teferra, D. & Altbach, P., G. (2003). “Trends and Perspectives in African Higher Education” In African Higher Education: An International Reference Handbook. Edited by Damtew Teferra and Philip G. Altbach. Indianapolis, Indiana University Press.
UNESCO Education Sector. (2016). Designing effective monitoring and evaluation of education systems for 2030: A global synthesiss of policies and practices.
Unruh, Glenys G. & Adolph Unruh. (1984). Curriculum Development: Problems, Processes, and Progress. Berkeley, CA: McCutchan Publishing Corporation.
