A Revisit of Holton’s HRD Evaluation and Research Model (2005) for Learning Transfer

##plugins.themes.bootstrap3.article.main##

Kulthida Mongkolsirikiet Chiraprapha Akaraborworn

Abstract

     The main purpose of this study was to revisit the Holton’s HRD Evaluation and Research Model (Holton III, 2005) for Learning Transfer in order to develop an instrument to measure the factors affecting the learning transfer of Thai employees. The study included the exclusive literature review of Edward Holton’s HRD Evaluation Model (Holton III, 2005) and the process of developing a new instrument of Learning Transfer. The research process was composed of two phases: Phase I: Scale Development, involving drafting an English version of a 72-item-scale from related literature review, conducting back translation, and testing content validity with HR experts by using Index of Item-Objective Congruence (IOC), and Phase II: Scale Validation, including and analyzing all of the items with Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) with 679 front-line employees from three large sized Thai commercial banks. The Exploratory Factor Analysis (EFA) results yielded six emerging constructs of the 71-item-scale, namely traits, employee commitment, motivation to improve work through learning, lack of opportunity to apply, supportive environment, and transfer design. The Confirmatory Factor Analysis (CFA) results confirmed the six-construct-model validation with a good fit. The results provided a strong support for the structure of 15 factors; 7 factors in the Specific Training domain and 8 factors in the General Training domain. The results of this study yield a new and comprehensive learning transfer measurement scale based on the emerged model that would contribute to not only academics, but also to Thai HRD practitioners and Thai banking sector to systemically diagnose. It also detects and solves problems of training effectiveness. Future studies should validate and test the model and the instrument with Structural Equation Modeling (SEM) in order to see the causal links among the latent variable.


Keywords: Learning Transfer, Instrument Development, Holton’s HRD Evaluation and Research Model

References

Alliger, G. M., Tannenbaum, S. I., Bennett, W., Jr., Traver, H., & Shotland, A. (1997). A Meta-Analysis of the Relations among Training Criteria. Personnel Psychology, 50(2), 341-358. http://dx.doi.org/10.1111/
j.1744-6570.1997.tb00911.x

ASTD. (2014). Content Community Global Perspectives: The Premier Conference for Training and Development Professionals. In ASTD 2014 International Conference & Exposition, May 4-7, 2014. Washington DC, USA: ASTD. Retrieved from http://webcasts.astd.org/uploads/assets/264/document/HowtoLeadaDelegationtoICE
2014.pdf

Baldwin, T. T., Magjuka, R. J., & Loher, B. T. (1991). The Perils of Participation: Effects of Choice of Training on Trainee Motivation and Learning. Personnel Psychology, 44(1), 51-65. DOI: 10.1111/j.1744-6570.
1991.tb00690.x

Bank of Thailand. (n.d.). Financial Status of Thai Commercial Banks Report. Retrieved from http://www2.bot.
or.th/statistics/ReportPage.aspx?reportID=679&language=th

Bates, R., Holton III, E. F., & Hatala, J. P. (2012). A Revised Learning Transfer System Inventory: Factorial Replication and Validation. Human Resource Development International, 15(5), 549-569, DOI: 10.1080/
13678868.2012.726872

Bates, R. A., Holton III, E. F., Seyler, D. L., & Carvalho, M. A. (2000). The Role of Interpersonal Factors in the Application of Computer-Based Training in an Industrial Setting. Human Resource Development International, 3(1), 19–42. https://doi.org/10.1080/136788600361920

Bhatti, M. A., & Kaur, S. (2010). The Role of Individual and Training Design Factors on Training Transfer. Journal of European Industrial Training, 34(7), 656-672. https://doi.org/10.1108/03090591011070770

Blume, B. D., Ford, J. K., Baldwin, T. T., & Huang, J. L. (2010). Transfer of Training: A Meta-Analytic Review. Journal of Management, 36(4), 1065–1105. https://doi.org/10.1177/0149206309352880

Boonkiat, S. (2003). Work Environment Factors Affecting the Transfer of Training: A Case Study of Telecommunication Company in Thailand. (Unpublished Master’s thesis). National Institute of Development Administration, Bangkok, Thailand.

Bumroongtham, P. (2008). The Study of Factors Affecting Learning Transfer from Training Course: A Case Study of Operation Employees at National Institute of Development Administration. (Unpublished Master’s thesis). National Institute of Development Administration, Bangkok, Thailand.

Button, S. B., Mathieu, J. E., & Zajac, D. M. (1996). Goal Orientation in Organizational Research: A Conceptual and Empirical Foundation. Organizational Behavior and Human Decision Processes, 67(1), 26-48. https://doi.org/10.1006/obhd.1996.0063

Chiaburu, D. S., & Marinova, S. V. (2005). What Predicts Skill Transfer? An Exploratory Study of Goal Orientation, Training Self-Efficacy and Organizational Supports. International Journal of Training and Development, 9(2), 110–23. https://doi.org/10.1111/j.1468-2419.2005.00225.x

Colquitt, J. A., LePine, J. A., & Noe, R. A. (2000). Toward an Integrative Theory of Training Motivation:
A Meta-Analytic Path Analysis of 20 Years of Research. Journal of Applied Psychology, 85(5), 678-707.

Dweck, C. S. (1989). Motivation. In A. Lesgold, & R. Glaser (Eds.), Foundations for a Psychology of Education (pp. 87-136). Hillsdale, NJ: Erlbaum.

Gegenfurtner, A., & Hagenauer, G. (2013). Achievement Goals and Achievement Goal Orientations in Education. International Journal of Educational Research, 61(1), 1-4. DOI: 10.1016/j.ijer.2013.08.001

Herold, D. M., Davis, W. D., Fedor, D. B., & Parsons, C. K. (2002). Dispositional Influences on Transfer of Learning in Multistage Training Programs. Personnel Psychology, 55(4), 851-869. DOI: 10.1111/j.1744-6570.2002.tb00132.x

Hicks, W. D., & Klimoski, R. J. (1987). Entry into Training Programs and its Effects on Training Outcomes: A Field Experiment. Academy of Management Journal, 30(3), 542-552. DOI: 10.2307/256013

Holton III, E. F. (1996). The Flawed Four-Level Evaluation Model. Human Resource Development Quarterly, 7(1), 5–21. https://doi.org/10.1002/hrdq.3920070103

Holton III, E. F. (2005). Holton’s Evaluation Model: New Evidence and Construct Elaborations. Advances in Developing Human Resources, 7(1), 37-54. DOI: 10.1177/1523422304272080

Holton III, E. F., Bates, R. A., & Ruona, W. E. A. (2000). Development of a Generalized Learning Transfer System Inventory. Human Resource Development Quarterly, 11(4), 333-360. DOI: 10.1002/1532-1096
(200024)11:4<333::AID-HRDQ2>3.0.CO;2-P

Holton III, E. F., Chen, H-C., & Naquin, S. S. (2003). An Examination of Learning Transfer System Characteristics across Organizational Settings. Human Resource Development Quarterly, 14(4), 459–482. https://doi.org/10.1002/hrdq.1079

Holton III, E. F., Bates, R. A., Bookter, A. I., & Yamkovenko, V. B. (2007). Convergent and Divergent Validity of the Learning Transfer System Inventory. Human Resource Development Quarterly, 18(3), 385-419. DOI: 10.1002/hrdq.1210

Holton III, E. F., Bates, R. A., Seyler, D. L., & Carvalho, M. B. (1997). Toward Construct Validation of a Transfer Climate Instrument. Human Resource Development Quarterly, 8(2), 95–113. http://dx.doi.org/10.
1002/hrdq.3920080203

Hooper, D., Coughlan, J., & Mullen, M. R. (2008). Structural Equation Modelling: Guidelines for Determining Model Fit. The Electronic Journal of Business Research Methods, 6(1), 53-60.

Hutchins, H. M., Nimon, K., Bates, R., & Holton, E. (2013). Can the LTSI Predict Transfer Performance? Testing Intent to Transfer as a Proximal Transfer of Training Outcome. International Journal of Selection and Assessment, 21(3), 251-263. https://doi.org/10.1111/ijsa.12035

John, O. P., Naumann, L. P., & Soto, C. J. (2008). Paradigm Shift to the Integrative Big Five Trait Taxonomy: History, Measurement, and Conceptual Issues. In O. P. John, R. W. Robins, & L. A. Pervin (Eds.), Handbook of Personality: Theory and Research (3rd ed.) (pp. 114-158). New York, NY: Guilford Press.

Jungsiriwattana, T. (2006). Factors Afftecing Trainng Transfer at Thai Airways. (Unpublished Master’s thesis). National Institute of Development Administration, Bangkok, Thailand.

Kasemsri, W. (2004). The Analysis of Motivation Factors of the Learning Transfer from Training Course in Operational Level Employees: A Case Study of Somboon Group Co., Ltd. (Unpublished Master’s thesis). National Institute of Development Administration, Bangkok, Thailand.

Kirkpatrick, D. L. (1959). Techniques for Evaluation Training Programs. Journal of the American Society of Training Directors, 13, 21-26.

Kirwan, C., & Birchall, D. (2006). Transfer of Learning from Management Development Programmes: Testing the Holton Model. International Journal of Training and Development, 10(4), 252-268. http://dx.doi.org/10.
1111/j.1468-2419.2006.00259.x

Laine, E., & Gegenfurtner, A. (2013). Stability or Change? Effects of Training Length and Time Lag on Achievement Goal Orientations and Transfer of Training. International Journal of Educational Research, 61, 71-79. https://doi.org/10.1016/j.ijer.2013.03.014

Lau, P. Y. Y., & McLean, G. N. (2013). Factors Influencing Perceived Learning Transfer of an Outdoor Management Development Programme in Malaysia. Human Resource Development International, 16(2),
186-204. DOI: 10.1080/13678868.2012.756157

Levenson, H. (1973). Multidimensional Locus of Control in Psychiatric Patients. Journal of Consulting and Clinical Psychology, 41(3), 397-404. http://dx.doi.org/10.1037/h0035357

Lim, D. H., & Morris, M. L. (2006). Influence of Trainee Characteristics, Instructional Satisfaction, and Organizational Climate on Perceived Learning and Training Transfer. Human Resource Development Quarterly, 17(1), 85-115. https://doi.org/10.1002/hrdq.1162

Machin, M. A., & Fogarty, G. J. (2004). Assessing the Antecedents of Transfer Intentions in a Training Context. International Journal of Training & Development, 8(3), 222-236. https://doi.org/10.1111/j.1360-3736.
2004.00210.x

Martocchio, J. J., & Webster, J. (1992). Effects of Feedback and Cognitive Playfulness on Performance in Microcomputer Software Training. Personnel Psychology, 45(3), 553–578. https://doi.org/10.1111/j.1744
-6570.1992.tb00860.x

Meyer, J. P., & Allen, N. J. (2004). TCM Employee Commitment Survey Academic Users Guide 2004. Ontario, Canada: Department of Psychology, University of Western Ontario.

Montesino, M. U. (2002). Strategic Alignment of Training, Transfer-Enhancing Behaviors, and Training Usage: A Posttraining Study. Human Resource Development Quarterly, 13(1), 89-108. DOI: 10.1002/hrdq.1015

Morgan, R. B., & Casper, W. J. (2000). Examining the Factor Structure of Participant Reactions to Training: A Multidimensional Approach. Human Resource Development Quarterly, 11(3), 301-317. https://doi.org/10.
1002/1532-1096(200023)11:3<301::AID-HRDQ7>3.0.CO;2-P

Naquin, S. S., & Holton III, E. F. (2002). The Effects of Personality, Affectivity and Work Commitment on Motivation to Improve Work tthrough Learning. Human Resource Development Quarterly, 13(4), 357-376. https://doi.org/10.1002/hrdq.1038

Naquin, S. S., & Holton III, E. F. (2003). Motivation to Improve Work through Learning in Human Resource Development. Human Resource Development International, 6(3), 355-370. https://doi.org/10.1080/1367
8860210154431

Noe, R. A. (1986). Trainees’ Attributes and Attitudes: Neglected Influences on Training Effectiveness. The Academy of Management Review, 11(4), 736-749. DOI: 10.2307/258393

Noe, R. A. (2000). Invited Reaction: Development of a Generalized Learning Transfer System Inventory. Human Resource Development Quarterly, 11(4), 361-365. https://doi.org/10.1002/1532-1096(200024)
11:4<361::AID-HRDQ3>3.0.CO;2-F

Paradise, A. (2007). State of the Industry Report. Alexandria, VA: American Society of Training and Development.

Rouiller, J. Z., & Goldstein, I. L. (1993). The Relationship between Organizational Transfer Climate and Positive Transfer of Training. Human Resource Development Quarterly, 4(4), 377-390. https://doi.org/10.
1002/hrdq.3920040408

Rovinelli, R. J., & Hambleton, R. K. (1977). On the Use of Content Specialists in the Assessment of Criterion-Referenced Test Item Validity. Tijdschrift voor Onderwijsresearch, 2(2), 49-60.

Ruona, W. E. A., Leimbach, M., Holton III, E. F., & Bates, R. (2002). The Relationship between Learner Utility Reactions and Predicted Learning Transfer Trainees. International Journal of Training and Development, 6(4), 218-228. https://doi.org/10.1111/1468-2419.00160

Saks, A. M. (2002). So is a Good Transfer of Training Estimate? A Reply to Fitzpatrick. The Industrial-Organizational Psychologist, 39, 29-30.

Smiti, P. (2009). THAILAND’s Perspective on Skills Training in the Workplace. Retrieved from http://www.
ilo.org/wcmsp5/groups/public/@asia/@ro-bangkok/documents/meetingdocument/wcms_120566.pdf

Swanson, R. A., & Holton III, E. F. (2005). Research in Organizations: Foundations and Methods of Inquiry. San Francisco, California: Berrett-Koehler Publishers.

Tan, J. A., Hall, R. J., & Boyce, C. (2003). The Role of Employee Reactions in Predicting Training Effectiveness. Human Resource Development Quarterly, 14(4), 397-411. https://doi.org/10.1002/hrdq.1076

Tannenbaum, S. I., Mathieu, J. E., Salas, E., & Cannon-Bowers, J. A. (1991). Meeting Trainees’ Expectations: The Influence of Training Fulfillment on the Development of Commitment, Self-Efficacy, and Motivation. Journal of Applied Psychology, 76(6), 759-769. http://dx.doi.org/10.1037/0021-9010.76.6.759

Tolentino, R. C. (2013). Organizational Commitment and Job Performance of the Academic and Administrative Personnel. International Journal of Information Technology and Business Management, 15(1), 51-59.

Vanichbuncha, K. (2013). Analyze Structural Equation Modeling with AMOS. Bangkok: Threelada.

Vathanalee, S. (2003). Developing the Measurement, Motivation Factors of the Learning Transfer from Training Courses in Operational Level Employees: A Case of Somboon Group Co., Ltd. (Unpublished Master’s thesis). National Institute of Development Administration, Bangkok, Thailand.

Webster, J., & Martocchio, J. J. (1993). Turning Work into Play: Implications for Microcomputer Software Training. Journal of Management, 19(1), 127-146. DOI: 10.1016/0149-2063(93)90049-S

Yamkovenko, B., & Holton, E. (2010). Toward a Theoretical Model of Dispositional Influences on Transfer of Learning: A Test of a Structural Model. Human Resource Development Quarterly, 21(4), 381-410. https://
doi.org/10.1002/hrdq.20054

Yamnill, S., & McLean, G. N. (2005). Factors Affecting Transfer of Training in Thailand. Human Resource Development Quarterly, 16(3), 323-344. https://doi.org/10.1002/hrdq.1142

Section
Research Articles

##plugins.themes.bootstrap3.article.details##

How to Cite
MONGKOLSIRIKIET, Kulthida; AKARABORWORN, Chiraprapha. A Revisit of Holton’s HRD Evaluation and Research Model (2005) for Learning Transfer. Journal of Community Development Research (Humanities and Social Sciences), [S.l.], v. 12, n. 2, p. 15-34, may 2019. ISSN 2985-0231. Available at: <https://www.journal.nu.ac.th/JCDR/article/view/Vol-12-No-2-2019-15-34>. Date accessed: 20 apr. 2024. doi: https://doi.org/10.14456/jcdr-hs.2019.12.