From Correlation to Causality in Training and Organization Performance Research: Using a Descriptive Validity Framework to Enhance Causal Inferences and Revolutionize the Field

Friday, February 23, 2024

9:15 AM - 10:45 AM East Coast USA Time

Location: Madison (Lobby Level)

Author(s)

TG

Thomas N. Garavan

Professor
University College Cork
Coirk, Cork, Ireland
ML

Millie Lai

Senior Lecturer
Manchester Metropolitan University
Manchester, England, United Kingdom
CG

Claire Gubbins

Professor
DCU Business School
Dublin, Dublin, Ireland
RC

Ronan Carbery

Vice Dean Graduate Studies & Director Executive MBA
University College Cork
Cork, Cork, Ireland
FO

Fergal O'Brien

Senior Lecturer
University of Limerick
Limerick, Limerick, Ireland

Abstract: While research-to-date reveals a positive association between training and organizational performance, numerous methodological and study reporting issues mean that we are unable to reach conclusions about forward- and reverse-causality. This paper therefore has two main aims. First, drawing on syntheses of prior research within the field and descriptive validity frameworks in other disciplines we develop a descriptive validity framework, specifying key elements of rigorous research design and reporting that will aid inferences about causality. Second, we use this framework to analyze 212 quantitative field-based studies ( 1978-2023) to identify and describe the descriptive validity practices prevalent in empirical studies and trends over time. We found that the majority of studies do not meet the methodological standards required to establish causality, with few studies meeting even the most basic requirements. We propose pragmatic guidelines for greater attention to descriptive validity.