University of Sussex
Browse

Using Bayes to get the most out of non-significant results

Download (658.83 kB)
journal contribution
posted on 2023-06-08, 21:32 authored by Zoltan DienesZoltan Dienes
No scientific conclusion follows automatically from a statistically non-significant result, yet people routinely use non-significant results to guide conclusions about the status of theories (or the effectiveness of practices). To know whether a non-significant result counts against a theory, or if it just indicates data insensitivity, researchers must use one of: power, intervals (such as confidence or credibility intervals), or else an indicator of the relative evidence for one theory over another, such as a Bayes factor. I argue Bayes factors allow theory to be linked to data in a way that overcomes the weaknesses of the other approaches. Specifically, Bayes factors use the data themselves to determine their sensitivity in distinguishing theories (unlike power), and they make use of those aspects of a theory’s predictions that are often easiest to specify (unlike power and intervals, which require specifying the minimal interesting value in order to address theory). Bayes factors provide a coherent approach to determining whether non-significant results support a null hypothesis over a theory, or whether the data are just insensitive. They allow accepting and rejecting the null hypothesis to be put on an equal footing. Concrete examples are provided to indicate the range of application of a simple online Bayes calculator, which reveal both the strengths and weaknesses of Bayes factors.

History

Publication status

  • Published

File Version

  • Published version

Journal

Frontiers in Psychology

ISSN

1664-1078

Publisher

Frontiers

Volume

5

Article number

a781

Department affiliated with

  • Psychology Publications

Full text available

  • Yes

Peer reviewed?

  • Yes

Legacy Posted Date

2015-07-09

First Open Access (FOA) Date

2021-03-10

First Compliant Deposit (FCD) Date

2021-03-10

Usage metrics

    University of Sussex (Publications)

    Categories

    No categories selected

    Licence

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC