Background:
Consumers can provide valuable input at different stages of the review process: in the production of evidence (e.g. prioritising or framing research questions, selecting outcomes and interpreting results), in making evidence accessible (e.g. commenting on reviews, improving readability) and in promoting the use of evidence. In 2017, resources and guidance were published for improved consumer involvement in Cochrane Reviews (ACTIVE project) and improved reporting of this involvement (GRIPP2 tool). This study follows up on our previous investigation, pre-dating these resources, which revealed marginal consumer involvement in Cochrane Reviews.
Objectives:
To assess the extent of consumer involvement in Cochrane Reviews: what roles they play, what tasks they perform and what impact they have, as well as who the consumers are.
Methods:
We searched the Cochrane Library for intervention reviews published from Feb 2017 to Feb 2018. We searched full texts for any mention of 'consumer', 'stakeholder' or 'user', and further scrutinised those that did. We extracted data on roles, tasks, level of involvement, impact and consumer characteristics.
Results:
We identified 359 intervention reviews. Of these, 199 mentioned one or more search terms, but only 61 (15 review groups) actually described some consumer involvement. Consumer roles were described as: editor (3); referee (16); member of international panel or stakeholder group (24); authors (8). The tasks performed by consumers were mainly providing feedback, assistance or advice in the editorial process. Adequate description of the level, and impact, of this involvement was typically lacking. In three reviews, consumers were part of a consultation process to select important outcomes for 'Summary of findings' tables and to prioritise research questions. In six reviews, authors stated that outcomes were 'selected based on relevance to consumers', but did not describe how they were involved.
Conclusions:
Our findings suggest that most review groups do not involve consumers. If they do, the type and level of involvement are poorly described. In addition, we do not know if the consumers used are representative of the larger populations. Review authors should be encouraged to use existing resources and guidance developed for the purpose of facilitating consumer involvement and reporting.