Workshop 7 (half day)
Separating Wheat From Chaff:
Interpreting Results From Contemporary Analytic Methods
Presenters: Rod McCloy, Human Resources Research Organization (HumRRO)
Gary Lautenschlager, University of Georgia
Coordinator: Wendy L. Richman-Hirsch, Mercer Human Resource Consulting
Sophisticated statistical research methods abound in the context of organizational research and practice. Practitioners and researchers alike face challenges with trying to keep apace of nuances in the reporting and interpretation of computer output from the wide variety of statistical analysis packages. Newer developments in the application and interpretation of research findings often challenge communication within and across research units. Our goal in this workshop is to survey a select set of methods and focus attention on sensemaking in the process: why one conducts such analyses and how one interprets the resulting output from available statistical packages. This workshop assumes some background knowledge on how one conducts these types of analyses, placing emphasis on appropriate use of the methods and their interpretation. The presenters plan to examine topics including confirmatory factor analysis, structural equation modeling, multilevel modeling, item response theory, logistic regression, and event history (a.k.a. survival) analysis. As appropriate, discussion will include issues in longitudinal as well as cross-sectional data analysis. The presenters will attempt to tailor the workshop to participant needs via a preworkshop survey. Final workshop topics will then be based upon participant needs meshed with presenters expertise. This workshop is directed towards experienced professionals who have an interest in refreshing and developing what they know about select modern data analysis methods and interpretation.
Upon completion of this workshop, participants will be able to:
- Describe issues confronted in interpreting results from complex analytic methods
- Explain the rationale for focusing on particular features of computer output
- List critical output features for the various methods covered
- Interpret the results provided correctly
- Explain choices among available approaches for interpreting results
- Apply lessons learned from select case studies provided to participants
Rod McCloy, a principal staff scientist for the Human Resources Research Organization (HumRRO), has conducted and directed personnel research for more than 15 years. The bulk of his research experience has involved individual differences assessment and quantitative analysis. He has directed and provided analytic assistance to many HumRRO projects, being well versed in several multivariate analytical techniques (e.g., covariance structure analysis, structural equation modeling, event history analysis, hierarchical linear modeling). His recent research efforts include development of noncognitive assessments, modeling attrition/retention, and development of a computer-adaptive test of cognitive ability. His dissertation describing a measurement model of performance determinants received SIOPs 1991 S. Rains Wallace Dissertation Award. Dr. McCloy received his PhD in I-O psychology, with specialization in psychometrics and statistics, from the University of Minnesota.
Gary Lautenschlager, a professor in the Applied Psychology Program at the University of Georgia, has over 20 years experience teaching courses in I-O psychology, quantitative methods, and psychological measurement. Gary has consulted on and presented seminars about statistical matters with a wide variety of for-profit, governmental and other not-for-profit organizations, and some of this has involved matters of litigation. He has published over 50 journal articles, papers, and related software tools for assisting in the analysis and interpretation of complex research methods in practical contexts. Gary reviews manuscripts, largely for research methods and statistical issues, for over 20 different professional journals, including Journal of Applied Psychology, Personnel Psychology, Journal of Organizational Behavior, Psychological Bulletin, Psychological Methods, Multivariate Behavioral Research, Journal of Management,
and Organizational Research Methods. Gary received his PhD in I-O psychology and quantitative methods from the University of Illinois-Chicago.
Return to Workshop List
Program