This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Pryjmachuk, S. Articles by Richards, D. A. Search for Related Content Social Bookmarking                         What's this?

Look before you leap and don’t put all your eggs in one basket

The need for caution and prudence in quantitative data analysis

School of Nursing, Midwifery and Social Work, University of Manchester

David A. Richards

Department of Health Sciences, University of York

This paper’s aim is to draw attention to the pitfalls that novice and, sometimes, experienced researchers fall into when undertaking quantitative data analysis in the health and social sciences, and to offer some guidance as to how such pitfalls might be avoided.

Many health and social science students are routinely instructed that the procedure for undertaking data analysis in quantitative research is as follows: specify hypotheses; collect data and enter it into a computerised statistical package; run various statistical procedures; examine the computer outputs for p-values that are statistically significant. If significant differences are found, jubilation often exists because statistically significant results are deemed to be a clear indicator that something worthwhile (and publishable) has been discovered. This paper argues that this approach has two major oversights: a failure to explore the raw data prior to analysis and an overdependence on p-values. Both of these oversights are routinely present in much health and social-science research, and both create problems for scientific rigour.

Researchers need to exercise caution (‘look before you leap’) and prudence (‘don’t put all your eggs in one basket’) when undertaking quantitative data analyses. Caution demands that, prior to full data analysis, researchers employ procedures such as data cleaning, data screening and exploratory data analysis. Prudence demands that researchers see p-values for their true worth, which exists only within the context of statistical theory, confidence intervals, effect sizes and the absolute meaning of statistical significance.

Key Words: statistics • research methods • quantitative approaches • statistical significance • exploratory data analysis

Journal of Research in Nursing, Vol. 12, No. 1, 43-54 (2007)
DOI: 10.1177/1744987106070260


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?