Assessing the methodological strengths and limitations of qualitative evidence: what are the key criteria?

Workshop category: 

  • Qualitative evidence synthesis methodology
Date and Location

Date: 

Tuesday 18 September 2018 - 14:00 to 15:30

Location: 

Tinto
Contact persons and facilitators

Contact person:

Claire Glenton
Simon Lewin

Facilitators:

Glenton C1, Lewin S2, Booth A3, Noyes J3
1 Cochrane Norway, Norway
2 EPOC, Norwegian Institute of Public Health and South African MRC, Norway
3 Cochrane Qualitative and Implementation Methods Group, United Kingdom
Target audience

Target audience: 

Qualitative primary researchers or qualitative evidence synthesis authors

Level of difficulty: 

Advanced
Type of workshop

Type of workshop : 

Discussion
Abstract

Abstract:

Background:
Qualitative evidence syntheses are increasingly used in decision making along with reviews of effectiveness. The GRADE-CERQual (Confidence in the Evidence from Reviews of Qualitative research) approach aims to assess how much confidence to place in evidence from reviews of qualitative research. Assessing the methodological limitations of individual studies contributing to a review finding is one of four components of CERQual. There is no agreement, however, on how best to assess such limitations. To address this issue, the GRADE-CERQual group has identified the criteria that are most common across existing tools, and is currently developing a tool to assess methodological strengths and limitations of qualitative evidence for use in decision making.

Objectives:
The objective of this session is to discuss a draft list of key criteria to consider when assessing methodological strengths and limitations of qualitative evidence.

Description:
The session will be presented and facilitated by members of the GRADE-CERQual co-ordinating team. The session is intended for review authors, methodologists and end users. Attendees should be experienced in qualitative research methods. The session will cover the following:
1) overview of the systematic mapping and content analysis of existing checklists;
2) presentation of the top 22 common criteria;
3) small group discussion to rank and discuss empirical evidence for criteria;
4) feedback.

Relevance to patients and consumers: 

Systematic reviews of qualitative evidence ('qualitative evidence syntheses') are now included in the Cochrane Library. Qualitative evidence syntheses can help ensure that the perspectives and experiences of stakeholders, including patients and health workers, are represented when important decisions are being made. However, we need ways of assessing the quality of these studies.