Discussion: View Thread

Expand all | Collapse all

AOM 2007 PDW - Alternatives to Null Hypothesis Significance Testing

  • 1.  AOM 2007 PDW - Alternatives to Null Hypothesis Significance Testing

    Posted 05-15-2007 16:25

    Professional Development Workshop (sponsored by the Research Methods Division)

    The Case Against Null Hypothesis Significance Testing: Flaws, Alternatives, and Action Plans

    Academy of Management Meeting in Philadelphia, PA
    Saturday, Aug 4 2007 8:00 – 9:50 AM
    Philadelphia Marriott in Grand Ballroom B

    Organizers:
    William H. Starbuck; University of Oregon
    Andreas Schwab; Louisiana State University
    Ingo Holzinger; York University

    Presenters:
    William H. Starbuck; University of Oregon
    Eric Abrahamson; Columbia University
    Jose M. Cortina; George Mason University

    The purpose of this workshop is to increase awareness among management researchers of the severe limitations of Null Hypothesis Significance Testing (NHST) and to introduce alternative approaches based on effect size measures and confidence intervals.  

    NHST has been criticized by methodologists on various grounds (Cohen, 1994; Cortina & Folger, 1998; Schmidt, 1996; Starbuck, 2006; Thompson, 1996).  Their criticism suggests that the extensive use of NHST in quantitative management research has led to the accumulation of deceptive findings in the management literature.  In a field that aspires to provide useful advice to managers, researchers need to focus on practically important effects that are robust across a wide variety of settings.  To identify practically meaningful findings, methodologists have recommended the reporting of effect sizes and confidence intervals as an alternative to NHST.  Recently, approaches for estimating confidence intervals for effect size measures have also been introduced (Cummings & Finch, 2001; Kline, 2004).  The application of alternatives to NHST by management researchers, however, has been limited by both a lack of sensitivity regarding the inherent problems of NHST and a limited familiarity with alternative approaches.  Consequently, our proposed two-hour workshop addresses these issues in the following three modules:

    • Critique of NHST (2 speakers)
    • Alternatives to NHST (1 speakers)
    • Round-table discussion for hands-on advice

    No pre-registration required to attend the session.

    For information on this session, please contact Andreas Schwab (aschwa3@lsu.edu) or Ingo Holzinger (iholzinger@schulich.yorku.ca).