About this Resource
How systematic should you be?
The stages of a systematic review
How systematic should you be? 
 


In the section the 'features of a good literature review' you explored your own beliefs relating to literature reviews.  Did you select words such as systematic, rigorous, explicit or transparent?  In medical sciences and some other fields systematic reviews aim to be unbiased and used a standardised process.  In the social sciences many critics of systematic reviews have argued that reviews cannot be unbiased and the structure imposed by the process is constraining.    

Read the following quotes.  To what extent do you agree with them? 

“As in any scientific endeavour, the methods to be used [in a literature review] should be established beforehand” (NHS Centre for Reviews and Dissemination).

“The distinguishing mark of good research is the awareness and acknowledgement of error and [hence] the necessity of establishing procedures which will minimise the effect such errors have on what counts as knowledge” (Ann Oakley).

“Reviews of social science literature will inevitably involve judgement. No set of procedural of statistical canons can make the review process immune to the reviewer’s biases. What we can do, however, is to require that reviewers make their procedures explicit and open, and we can ask that reviewers say enough about the studies they review to give readers a clear idea of what the original evidence is” (Mark Petticrew).  

A systematic review "...simply means that we follow an (appropriate, but not specific) system and that we communicate what we have done.  These are not markers of a systematic review – they are characteristics of ALL well-conducted, well-reported research" (Mary Dixon-Woods)

"...insisting that people follow a set of procedures rigidly can be a hindrance. Literally, it may rule out any reflection on issues that actually need attention, encouraging a rather pragmatic orientation. And this is especially likely where the time available for producing a review is very limited. As Polanyi points out, science, like many other activities, relies on skilled judgement, the capacity for which is built up through experience; and skilled judgement means taking account of particulars, and will often involve apparently breaking the rules" (Martyn Hammersley). 

How systematic do you want your review to be?

To what extent do you want to communicate to the reader what you hae done?

 

The text on this page was created by Professor David Denyer, Professor of Organizational Change, Cranfield School of Management.