Development of the CIPPO Evaluation Model at the Learning Factory of Vocational High Schools in South Sulawesi
Main Article Content
Abstract
To support structured evaluation of learning factory implementation, this study developed and evaluated a Context, Input, Process, Product, and Outcome (CIPPO) model for vocational high schools in South Sulawesi. A research and development approach based on the Borg and Gall model was employed, involving 80 participants from a population of 793 lecturers and vocational teachers engaged in learning factory implementation. Questionnaire data were analyzed using confirmatory factor analysis with LISREL. The evaluation framework encompassed eight constructs: management, workshop/laboratory, human resources, learning patterns, promotion and marketing, industry relations, products/services, and graduates. Reliability coefficients ranged from 0.812 for management to 0.914 for products/services, indicating acceptable to high internal consistency across the constructs. Expert validation yielded scores of 81.73% for content and 77.94% for media, both classified as feasible with revisions according to the study’s criteria. User assessments indicated that the model was rational, useful, and feasible for evaluating learning factory implementation. These findings provide preliminary support for the CIPPO model as a structured evaluation framework integrating institutional context, resources, implementation processes, products, and outcomes. The model offers a basis for evaluating learning factories in vocational education, subject to the revisions identified through expert validation. Further testing across a broader range of vocational schools is recommended to strengthen evidence of its applicability.
Citation Metrics:
Downloads
Citation Metrics & Similar Scopus Articles
-
Mamutova A.T. (2028)Development of a methodology for microstructural and thermal verification of the quality of an industrial Ti-10V-2Fe-3Al triple vacuum arc remelted ingotKompleksnoe Ispolzovanie Mineralnogo Syra, 344(1), 79-89
-
Berkinbayev G.D. (2028)Radioactivity as a prospecting indicator of rare earth, gold and polymetal deposits in eastern Kazakhstan and an indicator of increased radioecological hazard during their developmentKompleksnoe Ispolzovanie Mineralnogo Syra, 346(3), 40-51
-
Sergeevich P.V. (2028)Identification of Methane-Bearing Coal Seams in Borehole Sections of the Karaganda Basin Using Geophysical Logging DataKompleksnoe Ispolzovanie Mineralnogo Syra, 345(2), 72-83
Article Details
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
References
Abele, E., Metternich, J., Tisch, M., Chryssolouris, G., Sihn, W., ElMaraghy, H., Hummel, V., & Ranz, F. (2015). Learning factories for research, education, and training. Procedia CIRP, 32, 1–6. https://doi.org/10.1016/j.procir.2015.02.187
Amiruddin. (2017). The effectiveness of the 3-year vocational school and the 4-year vocational school as a school system through evaluation of the CIPP model [Doctoral dissertation, State University of Malang].
Baena, F., Guarin, A., Mora, J., Sauza, J., & Retat, S. (2017). Learning factory: The path to Industry 4.0. Procedia Manufacturing, 9, 73–80. https://doi.org/10.1016/j.promfg.2017.04.022
Bartelt, M., Stecken, J., & Kuhlenkötter, B. (2020). Automated production of individualized products for teaching I4.0 concepts. Procedia Manufacturing, 45, 337–342. https://doi.org/10.1016/j.promfg.2020.04.027
Borg, W. R., & Gall, M. D. (1983). Educational research: An introduction (4th ed.). Longman.
Cachay, J., Wennemer, J., Abele, E., & Tenberg, R. (2012). Study on action-oriented learning with a learning factory approach. Procedia—Social and Behavioral Sciences, 55, 1144–1153. https://doi.org/10.1016/j.sbspro.2012.09.608
Crabbé, A., & Leroy, P. (2008). The handbook of environmental policy evaluation. Earthscan.
Daraee, M., Salehi, K., & Mohsenpour, M. (2018). Using mixed method research to evaluate the quality of output and outcome of “School Management Excellence Program.” New Thoughts on Education, 14(1), 83–119. https://doi.org/10.22051/jontoe.2018.19279.2127
Directorate of Vocational High School Development. (2017). Governance of teaching factory implementation. Ministry of Education and Culture of the Republic of Indonesia. https://repositori.kemendikdasmen.go.id/4973/
Directorate of Vocational High School Development. (2020). Main data of the Directorate of Vocational High School Development. http://datapokok.ditpsmk.net/sekolah?menu=0&ubah=&id_prov=190000&id_kab=&id_kec=&id_bidang=10&id_program=&id_kompetensi=&sts=&cari=
Enke, J., Glass, R., & Metternich, J. (2017). Introducing a maturity model for learning factories. Procedia Manufacturing, 9, 1–8. https://doi.org/10.1016/j.promfg.2017.04.010
Gall, M. D., Gall, J. P., & Borg, W. R. (2003). Educational research: An introduction (7th ed.). Allyn & Bacon.
Grube, D., Malik, A. A., & Bilberg, A. (2019). SMEs can touch Industry 4.0 in the smart learning factory. Procedia Manufacturing, 31, 219–224. https://doi.org/10.1016/j.promfg.2019.03.035
Hadlock, H., Wells, S., Hall, J., Clifford, J., Winowich, N., & Burns, J. (2008). From practice to entrepreneurship: Rethinking the learning factory approach. In Proceedings of the 2008 IAJC-IJME International Conference (Paper 081). https://ijme.us/cd_08/PDF/81%20ENT%20P%20401.pdf
Henning, M., Hagedorn-Hansen, D., & von Leipzig, K. H. (2017). Metacognitive learning: Skills development through gamification at the Stellenbosch Learning Factory as a case study. South African Journal of Industrial Engineering, 28(3), 105–112. https://doi.org/10.7166/28-3-1845
Imansari, N., & Sutadji, E. (2017). A conceptual framework curriculum evaluation electrical engineering education. International Journal of Evaluation and Research in Education, 6(4), 265–269. https://doi.org/10.11591/ijere.v6i4.7624
Irfan, A. M. (2017). Development of community academy management model based on regional excellence potential and community needs [Doctoral dissertation, State University of Malang]. https://repository.um.ac.id/64871/
Issa, A., Lucke, D., & Bauernhansl, T. (2017). Mobilizing SMEs towards Industrie 4.0-enabled smart products. Procedia CIRP, 63, 670–674. https://doi.org/10.1016/j.procir.2017.03.346
Kagermann, H., Wahlster, W., & Helbig, J. (2013). Recommendations for implementing the strategic initiative Industrie 4.0: Securing the future of German manufacturing industry: Final report of the Industrie 4.0 Working Group. Forschungsunion; acatech. https://en.acatech.de/publication/recommendations-for-implementing-the-strategic-initiative-industrie-4-0-final-report-of-the-industrie-4-0-working-group/
Kochan, D., & Miksche, R. (2017). Advanced manufacturing and Industrie 4.0 for SME. In V. Majstorovic & Z. Jakovljevic (Eds.), Proceedings of 5th International Conference on Advanced Manufacturing Engineering and Technologies: NEWTECH 2017 (pp. 357–364). Springer. https://doi.org/10.1007/978-3-319-56430-2_26
Lamancusa, J. S., Jorgensen, J. E., Zayas-Castro, J. L., & Morell de Ramirez, L. (2001). The learning factory—Integrating design, manufacturing and business realities into engineering curricula: A sixth year report card. In Proceedings of the International Conference on Engineering Education.
Martaningsih, S. T., Soenarto, & Istiyono, E. (2019). Evaluation model of career counseling program in vocational high school. International Journal of Evaluation and Research in Education, 8(2), 318–329. https://doi.org/10.11591/ijere.v8i2.14986
Munigala, V., Oinonen, P., & Ekman, K. (2018). Envisioning future innovative experimental ecosystems through the foresight approach. Case: Design Factory. European Journal of Futures Research, 6(1), Article 1. https://doi.org/10.1007/s40309-017-0128-2
Ozdemir, S. M. (2013). Exploring the Turkish teachers’ professional development experiences and their needs for professional development. Mevlana International Journal of Education, 3(4), 250–264. https://doi.org/10.13054/mije.13.56.3.4
Prasetyono, H. (2016). Graduate program evaluation in the area leading educational, outlying and backward. Journal of Education and Practice, 7(36), 109–116. https://iiste.org/Journals/index.php/JEP/article/view/34641
Rangian, M., Peymanizad, H., & Esmailzadeh, M. R. (2021). Managmante and determining the employment status of sports science graduates of Islamic Azad Universities using the CIPPO model. Journal of Contemporary Issues in Business and Government, 27(2), 4318–4323. https://doi.org/10.47750/cibg.2021.27.02.457
Ryan, T. P. (2013). Sample size determination and power. John Wiley & Sons. https://doi.org/10.1002/9781118439241
Sadaj, E. A., Hulla, M. U., & Ramsauer, C. (2020). Design approach for a learning factory to train services. Procedia Manufacturing, 45, 60–65. https://doi.org/10.1016/j.promfg.2020.04.064
Samnur. (2017). Analysis of factors contributing to teacher competency levels and their impact on teaching factory readiness and types of continuous professional development for productive teachers in vocational high schools [Doctoral dissertation, State University of Malang]. https://repository.um.ac.id/64870/
Santiyadnya, N. (2015). The program evaluation of the implementation of productive skill competency test in SMK Negeri 3 Singaraja. JISAE: Journal of Indonesian Student Assessment and Evaluation, 1(1), 1–11. https://doi.org/10.21009/jisae.011.01
Sevilla, C. G., Ochave, J. A., Punsalan, T. G., Regala, B. P., & Uriarte, G. G. (2007). Research methods. Rex Printing Company.
Stufflebeam, D. L., & Zhang, G. (2017). The CIPP evaluation model: How to evaluate for improvement and accountability. Guilford Press.
Tisch, M., Hertle, C., Abele, E., Metternich, J., & Tenberg, R. (2016). Learning factory design: A competency-oriented approach integrating three design levels. International Journal of Computer Integrated Manufacturing, 29(12), 1355–1375. https://doi.org/10.1080/0951192X.2015.1033017
Wagner, U., AlGeddawy, T., ElMaraghy, H., & Müller, E. (2012). The state-of-the-art and prospects of learning factories. Procedia CIRP, 3, 109–114. https://doi.org/10.1016/j.procir.2012.07.020
Wagner, U., AlGeddawy, T., ElMaraghy, H., & Müller, E. (2015). Developing products for changeable learning factories. CIRP Journal of Manufacturing Science and Technology, 9, 146–158. https://doi.org/10.1016/j.cirpj.2014.11.001
Wijanto, S. H. (2008). Structural equation modeling dengan LISREL 8.8: Konsep dan tutorial. Graha Ilmu.
Yang, S., Liu, H., Zhang, Y., Arndt, T., Hofmann, C., Häfner, B., & Lanza, G. (2020). A data-driven approach for quality analytics of screwing processes in a global learning factory. Procedia Manufacturing, 45, 454–459. https://doi.org/10.1016/j.promfg.2020.04.052
Article Sidebar
Page Numbers:
8113-8129
Digital Object ID:
Viewed: 78 times
Downloaded: 45 times
LYAS Publisher cordially invites qualified professionals to serve as Editors or Reviewers. Your expertise will make an important contribution to maintaining and strengthening the academic quality of our publications. Interested applicants are kindly requested to complete the application form at the following link: Editors & Reviewers
Please feel free to contact us if you need any further information about the submission process or if you have any additional questions.
Authors:
Copyright :Authors retain copyright and grant the journal right of first publication.
Explore Our Journals
Find the journal that best fits your research. If this journal does not match your manuscript’s scope, explore our portfolio below to select a more suitable publication venue.