Justice Studies Research: Critical Appraisal

There are many different resources to help you conduct a thorough literature review.  A good one is available from the University of Toronto Library.

How to read a Journal Article from the University of Michigan.

Critical Appraisal

Critically appraising articles is vital to evaluating best practice for your population. There are many resources and checklists that can be used to critically appraise for clinical significance such as these Cochrane appraisal tools.

Common questions to ask when critically appraising an article:

• Is my research question clear and concise?
• Are the articles supporting my argument I am articulating in my research question?
• Was the sample size large enough for you to make some general results?
• Are the results statistically significant?
• Are the results clinically significant? 
• Did the authors address potential bias in the study?
• Did the researchers identify confounding variables? If so, explain how they authors use control factors.

In addition to appraising the research methodology and quality of your research, social workers should also consider the clinical application to their individual client and client population. Consider the following while you read through your research:

Before reading

• Do I have everything I need about the client’s history, culture, priorities
• Am I making assumptions or bringing forward any personal bias?
• Is my searching accurate to describe the context and history of my clients’ problems?  (e.g., “racism AND health” or “structural racism AND mental health” or “racial discrimination AND mental health”)
• Am I really prepared to assess the research?
• Am I using a broad range of knowledge sources and strategies for ways of knowing about a client?

During reading

• Document any questions that I have.
• Is each article/policy really showing the client’s experience and supporting what I my research question?
• Am I noting any structural racism or health inequities in the practices proposed in this policy or article?
• Does the intervention include any internalized scripts of racial, gender or other superiority and inferiority?
• Are there cultural or power contexts that need to be considered?

After reading

• Have I considered using multiple perspectives/disciplines to better understand the problem?
• Do I still need to learn more about my client's language, customs, history or context to better understand the problem?
• If I act on the evidence, am I contributing to dismantling structural racism, power inequities?
• If I move forward with these practices, am I contributing to create conditions where my client can thrive?

Once you have considered all these questions, you are ready to begin writing your paper.

Resource: NASW Evidence-based practice https://www.socialworkers.org/News/Research-Data/Social-Work-Policy-Research/Evidence-Based-Practice