An internal evaluation of higher education curriculum using data transformation model
DOI:
https://doi.org/10.37134/ajatel.vol10.2.1.2020Keywords:
Internal Evaluation, Curriculum Studies, Higher Education, Mixed Method, Data Transformation ModelAbstract
A curriculum does not exist in a void; internal members play a key role in responding to the different forces that continually shape it. One of the approaches to evaluation is through internal evaluation from the perspective of the inside members who work with the curriculum. However, the internal evaluation may pose restricted evaluation due to the innate subjective human judgment. Considering these contexts, this paper performed a pilot internal evaluation of a selected aspect of a higher education curriculum using a triangulation mixed method design called the data transformation model. Based on the results, the evaluation using the data transformation model probed important points of agreement and discrepancy in the data sets. The implications for evaluation theory and curriculum practice are discussed. It is suggested that an extension of the current formative internal evaluation continuing the tradition of data transformative model but progressively focusing on larger aspects of the curriculum should be further conducted.
Downloads
Download data is not yet available.
References
Akarem, H.S. & Hossain, S.S. (2016). Determinants of education quality: what makes students’ perception different? Journal Open Review of Educational Research, 3(1), 52-67.
https://doi.org/10.1080/23265507.2016.1155167
Barnett, R., Becher R.A. & Cork, N.M. (1987). Models of Professional Preparation: pharmacy, nursing, and teacher education. Studies in Higher Education, 12(1), 51-63.
https://doi.org/10.1080/03075078712331378270
Churchman, R. & Woodhouse, D. (1998). Professional, regulatory & statutory bodies and higher education institutions [Monograph]. New Zealand Universities Academic Audit Unit, New Zealand. Retrieved from
https://www.aqa.ac.nz/sites/all/files/ASQ1.pdf
Clifford, D.L. (1987). Consideration of simple measures and organizational structure. Evaluation and Program Planning 10(23), 1-237.
https://doi.org/10.1016/0149-7189(87)90034-6
Cohen, A. M., and Brawer, F. B. (1986). The collegiate curriculum. Community College Review, 14(3), 13.
https://doi.org/10.1177/009155218601400302
Conchada, M.I.P. & Tiongco, M.M. (2015). A Review of the accreditation system for Philippine higher education institutions (Report No. 2015-30). Makati City: Philippine Institute for Development Studies.
Creswell, J.W. & Plano Clark, V.L. (2011). Designing and conducting mixed methods research (2nd ed.). Los Angeles: Sage.
Giacquinta, J.B. (1998) Seduced and abandoned: some lasting conclusions about planned change from the Cambire school study. In A. Hargreaves et al. (eds.), International Handbook of Educational Change (pp.163-180). London: Kluwer Academic Publishers.
Greene, J.C. 2007. Is mixed methods social inquiry a distinctive methodology? Journal of Mixed Methods Research, 2(1), 7-22.
https://doi.org/10.1177/1558689807309969
Harman, K.M. (1989). Professional versus academic values: Cultural ambivalence in university professional school in Australia. Higher Education, 18, 401-509.
https://doi.org/10.1007/BF00138744
Harvey, L., Mason, S., & Ward, R. (2014). The role of professional bodies in higher education quality monitoring. Birmingham: Author.
Hegde, V.N. & Rao, N. (2015). An outcome based curriculum design in engineering - Case study approach. Journal of Engineering Education Transformations, 29(2), 41-46.
https://doi.org/10.16920/jeet/2015/v29i2/83041
International Education Systems (2017). Internal evaluation report. South Africa: Hout Bay International School. Retrieved from
https://houtbayinternational.co.za/wp-content/uploads/sites/2/2017/11/IQAA-Report-2017.pdf
International University of Sarajevo (2018). Internal evaluation report. Sarajevo, Bosnia and Herzegovina: Faculty of Law. Retrieved from
https://www.ius.edu.ba/sites/default/files/docs/appendix_9_internal_evaluation_report_faculty_of_law_2017-2018.pdf
Johnson, R.B. & Christensen, L.B. (2017). Educational research: Quantitative, qualitative, and mixed approaches (6th ed.). Los Angeles: Sage.
Jupp, V. (2006). The SAGE Dictionary of Social Research Methods. London: Sage Publications.
Kennedy, M.M. (1983). The role of the in-house evaluator. Evaluation Review, 7(4), 519-541.
https://doi.org/10.1177/0193841x8300700406
Kim, H.S. (2012). Outcomes-based Curriculum Development and Student Evaluation in Nursing Education. Journal of Korean Academy of Nursing, 42(7), 917-927.
http://dx.doi.org/10.4040/jkan.2012.42.7.917
Klongvessa, N. (2011, March). Outcome-based curriculum and alteration in landscape architecture lesson plan. Paper presented at IFLA APR Symposium on Landscape Architecture Education, Putra, Malaysia. Retrieved from
http://www.land.arch.chula.ac.th/eng/service.php?catid=6
Kyoto University Graduate School of Management (2015). Internal assessment and evaluation report. Kyoto, Japan: Education Division. Retrieved from
http://www.kyoto-u.ac.jp/ja/about/evaluation/estimate/documents/nin-hyoka110329-3.pdf
Love, A.J. (1998). Internal evaluation: integrating evaluation and social work practice. Scandinavian Journal of Social Welfare, 7(2), 145-151. Retrieved from
https://doi.org/10.1111/j.1468-2397.1997.tb00191.x.
Makaran, D. (2015). Factors influencing curriculum development process in secondary school education in Mogadishu, Somalia. (M.A. thesis). Retrieved from
http://erepository.uonbi.ac.ke
Michaud, N. (2015). Why philosophy is important for administrators in education. Journal of Inquiry & Action in Education, 6(3), 74-86. Retrieved from
https://files.eric.ed.gov/fulltext/EJ1133494.pdf
Moore, D. S., & McCabe, G. P. (2005). Introduction to the practice of statistics (5th ed.). New York: W.H. Freeman & Company.
Nevo, D. (2001). School evaluation: internal or external? Studies in Educational Evaluation, 27(2), 95-106.
https://doi.org/10.1016/S0191-491X(01)00016-5
Nelson, R., Ehren, M., & Godfrey, D. (2017). Literature review on internal evaluation. [Review at Institute of Education University College London] Retrieved from
http://www.schoolinspections.eu/wp-content/uploads/downloads/2015/09/Literature-review-internal-evaluation.pdf
Norman, P.J. & Sherwood, S.A.S. (2015) Using internal and external evaluation to shape teacher preparation curriculum: a model for continuous program improvement. The New Educator, 11(1), 4-23.
https://doi.org/10.1080/1547688x.2015.1001263
Onwuegbuzie, A.J. & Johnson, R.B. (2006). The “validity” issue in mixed research. Research in the Schools, 13, 48-63. Retrieved from
https://www.semanticscholar.org/paper/The-Validity-Issue-in-Mixed-Research-Onwuegbuzie-Johnson/6bfec4b77e5befdd1282de319b08294ba7913aaf
Ornstein, A.C. & Hunkins, F.P. (2004). Curriculum: Foundations, principles, and issues (6th ed.). Boston: Allyn & Bacon.
Peretz, M.B. (2003). Curriculum reform in Israel: The power of individuals and other forces. In J. Van den Akker et al. (eds.). Curriculum landscapes and trends (pp. 45-59). Dordrecht: Kluwer Academic Publishers.
Sellwood-Davis, S.C. (2016) An internal evaluation of a health program for adults with mild, moderate, and severe intellectual disabilities (Doctoral dissertation).
https://doi.org/10.13023/ETD.2016.465
Simons, H.L. (1988). Accreditation and curricular change. In D.R. Wolf & M.I. Zoglin (eds.). External influencer on the curriculum: new directions for community colleges (pp. 61-70). San Francisco: Jossry-Bass
Skilbeck, M. (1984). School-based curriculum development. London: Harper & Row.
Suen, L.W., Huang, H., & Lee, H. (2014). A comparison of convenience sampling and purposive sampling. Hu Li Za Zhi, 61(3), 105-111.
https://doi.org/10.11648/j.ajtas.20160501.11
Taba, H. (1962). Curriculum development: Theory and practice. New York: Harcourt Brace Jovanovich.
Technological Educational Institute of Athens (2010). Internal evaluation report. Athens, Greece: Faculty of Management & Economics, Department of Library Science and Information Systems. Retrieved from
http://www.teiath.gr/userfiles/mdendr/documents/internal_evaluation_report_final_en_june2011.pdf
Thomas, C.S. (2017). Interest group. In Encyclopædia Britannica. Retrieved from
https://www.britannica.com/topic/interest-group
Torchim, W. (2006). Descriptive Statistics. Web Center for Social Research Methods. Retrieved from
https://socialresearchmethods.net/kb/statdesc.php.
Tyler, M.C. (2005) A fundamental choice: internal or external evaluation? Evaluation Journal of Australasia, 4(1), 3-11.
https://doi.org/10.1177/1035719x05004001-202
Tyler, R.W. (1949). Basic principles of curriculum and instruction. Chicago: University of Chicago Press.
Vajargah, K.F., Babadi, A.K., & Hajatmand, F. (2014). Evaluating the internal quality of educational programs of Ph.D. medical ethics curriculum from point of professors and students. Medical Ethics Journal, 8(27), 129-152. Retrieved from
http://journals.sbmu.ac.ir/en-me/rt/printerFriendly/10176/0
Watson, D. (1992) The changing shape of professional education. In Bines, H. & Watson, D., Developing professional education, Buckingham: SRHE and Open University Press
Yeung, S.S. (2010). Using school evaluation policy to effect curriculum change? A reflection on the SSE and ESR exercise in Hong Kong. Educational Research Journal, 25(2), 187-209. Retrieved from
https://search.informit.com.au/documentSummary;dn=406753057990392;res=IELHSS
Yusa, A., Hynie, M., & Mitchell, S. (2016). Utilization of internal evaluation results by community mental health organizations: Credibility in different forms. Evaluation and Program Planning, 54, 11–18.
http://dx.doi.org/10.1016/j.evalprogplan.2015.09.006
https://doi.org/10.1080/23265507.2016.1155167
Barnett, R., Becher R.A. & Cork, N.M. (1987). Models of Professional Preparation: pharmacy, nursing, and teacher education. Studies in Higher Education, 12(1), 51-63.
https://doi.org/10.1080/03075078712331378270
Churchman, R. & Woodhouse, D. (1998). Professional, regulatory & statutory bodies and higher education institutions [Monograph]. New Zealand Universities Academic Audit Unit, New Zealand. Retrieved from
https://www.aqa.ac.nz/sites/all/files/ASQ1.pdf
Clifford, D.L. (1987). Consideration of simple measures and organizational structure. Evaluation and Program Planning 10(23), 1-237.
https://doi.org/10.1016/0149-7189(87)90034-6
Cohen, A. M., and Brawer, F. B. (1986). The collegiate curriculum. Community College Review, 14(3), 13.
https://doi.org/10.1177/009155218601400302
Conchada, M.I.P. & Tiongco, M.M. (2015). A Review of the accreditation system for Philippine higher education institutions (Report No. 2015-30). Makati City: Philippine Institute for Development Studies.
Creswell, J.W. & Plano Clark, V.L. (2011). Designing and conducting mixed methods research (2nd ed.). Los Angeles: Sage.
Giacquinta, J.B. (1998) Seduced and abandoned: some lasting conclusions about planned change from the Cambire school study. In A. Hargreaves et al. (eds.), International Handbook of Educational Change (pp.163-180). London: Kluwer Academic Publishers.
Greene, J.C. 2007. Is mixed methods social inquiry a distinctive methodology? Journal of Mixed Methods Research, 2(1), 7-22.
https://doi.org/10.1177/1558689807309969
Harman, K.M. (1989). Professional versus academic values: Cultural ambivalence in university professional school in Australia. Higher Education, 18, 401-509.
https://doi.org/10.1007/BF00138744
Harvey, L., Mason, S., & Ward, R. (2014). The role of professional bodies in higher education quality monitoring. Birmingham: Author.
Hegde, V.N. & Rao, N. (2015). An outcome based curriculum design in engineering - Case study approach. Journal of Engineering Education Transformations, 29(2), 41-46.
https://doi.org/10.16920/jeet/2015/v29i2/83041
International Education Systems (2017). Internal evaluation report. South Africa: Hout Bay International School. Retrieved from
https://houtbayinternational.co.za/wp-content/uploads/sites/2/2017/11/IQAA-Report-2017.pdf
International University of Sarajevo (2018). Internal evaluation report. Sarajevo, Bosnia and Herzegovina: Faculty of Law. Retrieved from
https://www.ius.edu.ba/sites/default/files/docs/appendix_9_internal_evaluation_report_faculty_of_law_2017-2018.pdf
Johnson, R.B. & Christensen, L.B. (2017). Educational research: Quantitative, qualitative, and mixed approaches (6th ed.). Los Angeles: Sage.
Jupp, V. (2006). The SAGE Dictionary of Social Research Methods. London: Sage Publications.
Kennedy, M.M. (1983). The role of the in-house evaluator. Evaluation Review, 7(4), 519-541.
https://doi.org/10.1177/0193841x8300700406
Kim, H.S. (2012). Outcomes-based Curriculum Development and Student Evaluation in Nursing Education. Journal of Korean Academy of Nursing, 42(7), 917-927.
http://dx.doi.org/10.4040/jkan.2012.42.7.917
Klongvessa, N. (2011, March). Outcome-based curriculum and alteration in landscape architecture lesson plan. Paper presented at IFLA APR Symposium on Landscape Architecture Education, Putra, Malaysia. Retrieved from
http://www.land.arch.chula.ac.th/eng/service.php?catid=6
Kyoto University Graduate School of Management (2015). Internal assessment and evaluation report. Kyoto, Japan: Education Division. Retrieved from
http://www.kyoto-u.ac.jp/ja/about/evaluation/estimate/documents/nin-hyoka110329-3.pdf
Love, A.J. (1998). Internal evaluation: integrating evaluation and social work practice. Scandinavian Journal of Social Welfare, 7(2), 145-151. Retrieved from
https://doi.org/10.1111/j.1468-2397.1997.tb00191.x.
Makaran, D. (2015). Factors influencing curriculum development process in secondary school education in Mogadishu, Somalia. (M.A. thesis). Retrieved from
http://erepository.uonbi.ac.ke
Michaud, N. (2015). Why philosophy is important for administrators in education. Journal of Inquiry & Action in Education, 6(3), 74-86. Retrieved from
https://files.eric.ed.gov/fulltext/EJ1133494.pdf
Moore, D. S., & McCabe, G. P. (2005). Introduction to the practice of statistics (5th ed.). New York: W.H. Freeman & Company.
Nevo, D. (2001). School evaluation: internal or external? Studies in Educational Evaluation, 27(2), 95-106.
https://doi.org/10.1016/S0191-491X(01)00016-5
Nelson, R., Ehren, M., & Godfrey, D. (2017). Literature review on internal evaluation. [Review at Institute of Education University College London] Retrieved from
http://www.schoolinspections.eu/wp-content/uploads/downloads/2015/09/Literature-review-internal-evaluation.pdf
Norman, P.J. & Sherwood, S.A.S. (2015) Using internal and external evaluation to shape teacher preparation curriculum: a model for continuous program improvement. The New Educator, 11(1), 4-23.
https://doi.org/10.1080/1547688x.2015.1001263
Onwuegbuzie, A.J. & Johnson, R.B. (2006). The “validity” issue in mixed research. Research in the Schools, 13, 48-63. Retrieved from
https://www.semanticscholar.org/paper/The-Validity-Issue-in-Mixed-Research-Onwuegbuzie-Johnson/6bfec4b77e5befdd1282de319b08294ba7913aaf
Ornstein, A.C. & Hunkins, F.P. (2004). Curriculum: Foundations, principles, and issues (6th ed.). Boston: Allyn & Bacon.
Peretz, M.B. (2003). Curriculum reform in Israel: The power of individuals and other forces. In J. Van den Akker et al. (eds.). Curriculum landscapes and trends (pp. 45-59). Dordrecht: Kluwer Academic Publishers.
Sellwood-Davis, S.C. (2016) An internal evaluation of a health program for adults with mild, moderate, and severe intellectual disabilities (Doctoral dissertation).
https://doi.org/10.13023/ETD.2016.465
Simons, H.L. (1988). Accreditation and curricular change. In D.R. Wolf & M.I. Zoglin (eds.). External influencer on the curriculum: new directions for community colleges (pp. 61-70). San Francisco: Jossry-Bass
Skilbeck, M. (1984). School-based curriculum development. London: Harper & Row.
Suen, L.W., Huang, H., & Lee, H. (2014). A comparison of convenience sampling and purposive sampling. Hu Li Za Zhi, 61(3), 105-111.
https://doi.org/10.11648/j.ajtas.20160501.11
Taba, H. (1962). Curriculum development: Theory and practice. New York: Harcourt Brace Jovanovich.
Technological Educational Institute of Athens (2010). Internal evaluation report. Athens, Greece: Faculty of Management & Economics, Department of Library Science and Information Systems. Retrieved from
http://www.teiath.gr/userfiles/mdendr/documents/internal_evaluation_report_final_en_june2011.pdf
Thomas, C.S. (2017). Interest group. In Encyclopædia Britannica. Retrieved from
https://www.britannica.com/topic/interest-group
Torchim, W. (2006). Descriptive Statistics. Web Center for Social Research Methods. Retrieved from
https://socialresearchmethods.net/kb/statdesc.php.
Tyler, M.C. (2005) A fundamental choice: internal or external evaluation? Evaluation Journal of Australasia, 4(1), 3-11.
https://doi.org/10.1177/1035719x05004001-202
Tyler, R.W. (1949). Basic principles of curriculum and instruction. Chicago: University of Chicago Press.
Vajargah, K.F., Babadi, A.K., & Hajatmand, F. (2014). Evaluating the internal quality of educational programs of Ph.D. medical ethics curriculum from point of professors and students. Medical Ethics Journal, 8(27), 129-152. Retrieved from
http://journals.sbmu.ac.ir/en-me/rt/printerFriendly/10176/0
Watson, D. (1992) The changing shape of professional education. In Bines, H. & Watson, D., Developing professional education, Buckingham: SRHE and Open University Press
Yeung, S.S. (2010). Using school evaluation policy to effect curriculum change? A reflection on the SSE and ESR exercise in Hong Kong. Educational Research Journal, 25(2), 187-209. Retrieved from
https://search.informit.com.au/documentSummary;dn=406753057990392;res=IELHSS
Yusa, A., Hynie, M., & Mitchell, S. (2016). Utilization of internal evaluation results by community mental health organizations: Credibility in different forms. Evaluation and Program Planning, 54, 11–18.
http://dx.doi.org/10.1016/j.evalprogplan.2015.09.006
Downloads
Published
2020-07-03
How to Cite
Cahapay, M. B. (2020). An internal evaluation of higher education curriculum using data transformation model. Asian Journal of Assessment in Teaching and Learning, 10(2), 1–9. https://doi.org/10.37134/ajatel.vol10.2.1.2020
Issue
Section
Articles
