metricas
covid
Buscar en
Cirugía Española (English Edition)
Toda la web
Inicio Cirugía Española (English Edition) Systematic reviews and meta-analyses in surgery
Información de la revista
Vol. 100. Núm. 8.
Páginas 514-516 (agosto 2022)
Visitas
266
Vol. 100. Núm. 8.
Páginas 514-516 (agosto 2022)
Methodological letter
Acceso a texto completo
Systematic reviews and meta-analyses in surgery
La revisión sistemática y el metaanálisis en cirugía
Visitas
266
Marta Roquéa,b,
Autor para correspondencia
mroque@santpau.cat

Corresponding author.
, Gerard Urrútiaa,b, Erik von Elmc
a Centro Cochrane Iberoamericano-Institut d’Investigació Biomèdica Sant Pau (IIB Sant Pau)
b CIBERESP
c Cochrane Switzerland, Center for Primary Care and Public Health (Unisanté), University of Lausanne, Lausanne, Switzerland
Este artículo ha recibido
Información del artículo
Texto completo
Bibliografía
Descargar PDF
Estadísticas
Texto completo
Introduction

Systematic reviews (SR) are a type of research that answers clearly formulated clinical questions of interest through a systematic and explicit process to search for and select all potentially relevant primary studies and to assess, analyse and interpret them, using rigorous methods to limit bias and random error1. This methodological note presents the main methodological aspects for developing and interpreting a SR, based on the formulations of Cochrane and other relevant guidelines, with emphasis on the specificities of SRs in surgery2,3.

Protocol drafting

Good quality SRs are based on previous protocols, prospectively registered to avoid redundancies and avoid biases in the reports, which guarantee transparency and rigour during the development and a higher methodological quality of the resulting SR. resultante4,5. The main international registry of protocols for systematic reviews is PROSPERO (http://www.crd.york.ac.uk/prospero/).

The protocol of an SR should present the planned methods for each of the 6 steps common to all SRs, which we will review below.

Stages in the development of a systematic reviewDefinition of the clinical question of interest

The first step is to correctly formulate the clinical question of interest that motivates the SR. SRs for interventions aim to answer therapeutic questions that can be structured, in a general way, following the key elements of the PICO model6. SRs that answer other types of questions, such as prognostic questions, follow other structures, with elements specific to each type of question6.

The selection criteria for the primary studies in the review are derived from the elements of the question of interest:

  • 1.

    Type of study participants. It is important that the criteria defining the disease or condition of interest are well detailed so that they can be verified in the studies identified by the search. Patient presentation (previous surgeries and treatments) should be considered.

  • 2.

    Type of intervention assessed in the study. The intervention should also be well defined, although it is important to anticipate that there may be acceptable variations between studies in terms of the specific treatment modality applied. In SRs of surgery, a particular effort should be made to describe not only the surgical technique following standardised guidelines, e.g., TIDieR and Blencowe guidelines7,8, but also the characteristics of its implementation, such as team profile, training and experience.

  • 3.

    Type of comparison used in the study. Sometimes, depending on the context, the appropriate control for comparison will be a simulated intervention, not an active intervention, another modality of surgery, or a non-surgical intervention.

  • 4.

    Types of outcomes of interest assessed in the study. It is important that the authors of the review establish a priori a list of outcomes, ordered by their clinical relevance, referring to efficacy and safety, and also patient-reported outcome.

  • 5.

    The type of study(ies), referring to the eligible study design for SR.

Identification and selection of the relevant studies

SRs are characterised by comprehensive literature searches that have, at a minimum, an electronic database search component. Generally speaking, it may be sufficient to search MEDLINE and the Cochrane Central Register of Controlled Trials (CENTRAL) to obtain an efficient search of an SR of a surgical intervention9. It should be noted that EMBASE does not contribute substantially to reviews of surgical interventions, but may be valuable in reviews that also consider a pharmacological intervention. Furthermore, these searches should be complemented by searches of other databases and alternative sources, such as prospective study registries (e.g., Clinicaltrials.gov).

Evaluation of the risk of bias of included studies

Current tools for assessing risk of bias are organised on the basis of classical epidemiological biases related to each type of research question. In the case of interventional SRs, the preferred study design to be included is randomised clinical trials. For this design, the most common risk of bias scale is Cochrane’s Risk of Bias, which assesses the domains of randomisation of participants, blinding of interventions (to patients, research staff and evaluators), loss following and publication bias2.

In surgery studies, the actual feasibility of masking the intervention should be considered, as well as the risk of bias related to the dependence of the intervention on the personnel delivering the intervention (training, characteristics, criteria for allocation of professionals to intervention groups) and on the commercial funding of the studies.

Incomplete description of interventions has been reported in primary surgery studies, which may limit the assessment of bias sources10,11.

Intervention SRs involving observational studies, as well as those answering non-intervention questions, should apply other specific risk of bias assessment tools12.

Summary of the evidence and presentation of outcomes

The type of synthesis of results that will be possible in the SR and its degree of precision will depend, among other things, on the amount of information available in the primary studies and the homogeneity between them. The quantitative synthesis of the results is carried out using the meta-analysis technique, the methodology of which is widely described2.

It should be emphasised that a necessary step prior to any meta-analysis is the evaluation of the clinical and statistical heterogeneity existing in the set of available studies, which will inform us whether it is reasonable to make a quantitative synthesis of their findings, which statistical model of meta-analysis should be applied and whether additional research is required into the causes of the heterogeneity detected, for example, by means of subgroup analysis and sensitivity or meta-regression. In the field of surgical studies, it is common to observe great clinical variability (either in the techniques evaluated, in the contexts considered in the studies or in the definition and measurement of the results), which discourages quantitative synthesis with meta-analysis. In this situation, the authors have the SWiM guide to formulate and describe the process of narrative synthesis of evidence13.

Interpretation of outcomes and evaluation of the quality of the evidence

The quality (or also confidence or certainty) of the evidence in an SR is the degree of confidence we can have that the effect estimate observed in the meta-analysis is close to the true value of the effect. The certainty of the evidence is best assessed using the GRADE system, in which the certainty in the estimates obtained for each of the SR outcomes of interest is classified as high, moderate, low or very low. Factors that will influence the level of certainty assigned are the design of available studies, limitations in study design or execution, inconsistency between estimates (heterogeneity), indirect evidence, imprecision in estimates, and publication bias14,15.

Systematic review report

Several guidelines are available to guide transparent and complete reporting of SRs, such as the PRISMA statement for reporting SRs and meta-analysess16 and its extensions, generated by the EQUATOR initiative (https://www.equator-network.org/). In addition, the evidence-based TIDieR-SR guideline for the reporting of SR interventions, evaluated in a cohort of surgery reviews, has been proposed17.

References
[1]
D.J. Cook, C.D. Mulrow, R.B. Haynes.
Systematic reviews: synthesis of best evidence for clinical decisions.
Ann Intern Med, 126 (1997), pp. 376-380
[2]
Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, et al (editors). Cochrane Handbook for systematic reviews of interventions version 6.2 (updated February 2021).
[3]
E. Kalkum, R. Klotz, S. Seide, F.J. Hüttner, K.F. Kowalewski, F. Nickel, et al.
Systematic reviews in surgery-recommendations from the Study Center of the German Society of Surgery.
Langenbecks Arch Surg, 406 (2021), pp. 1723-1731
[4]
L. Stewart, D. Moher, P. Shekelle.
Why prospective registration of systematic reviews makes sense.
[5]
M.B.F. Dos Santos, B.A. Agostini, R. Bassani, G.K.R. Pereira, R. Sarkis-Onofre.
Protocol registration improves reporting quality of systematic reviews in dentistry.
BMC Med Res Methodol, 20 (2020), pp. 57
[6]
Z. Munn, C. Stern, E. Aromataris, C. Lockwood, Z. Jordan.
What kind of systematic review should I conduct? A proposed typology and guidance for systematic reviewers in the medical and health sciences.
BMC Med Res Methodol, 18 (2018), pp. 5
[7]
T.C. Hoffmann, P.P. Glasziou, I. Boutron, R. Milne, R. Perera, D. Moher, et al.
Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide.
BMJ, 348 (2014), pp. g1687
[8]
N.S. Blencowe, N. Mills, J.A. Cook, J.L. Donovan, C.A. Rogers, P. Whiting, et al.
Standardizing and monitoring the delivery of surgical interventions in randomized clinical trials.
Br J Surg, 103 (2016), pp. 1377-1384
[9]
K. Goossen, S. Tenckhoff, P. Probst, K. Grummich, A.L. Mihaljevic, M.W. Büchler, et al.
Optimal literature search for systematic reviews in surgery.
Langenbecks Arch Surg, 403 (2018), pp. 119-129
[10]
S. Tyrell, E. Coates, S.R. Brown, M.J. Lee.
A systematic review of the quality of reporting of interventions in the surgical treatment of Crohn’s anal fistula: an assessment using the TIDiER and Blencowe frameworks.
Tech Coloproctol, 25 (2021), pp. 359-369
[11]
A.C. Currie, N. Penney, A. Kamocka, P. Singh, N. Abbassi-Ghadi, S.R. Preston.
Systematic review on reporting of components and outcomes in randomized clinical trials of paraoesophageal hernia mesh repair.
Br J Surg, 108 (2021), pp. 256-264
[12]
M. Roqué, L. Martínez-García, I. Solà, P. Alonso-Coello, X. Bonfill, J. Zamora.
Toolkit of methodological resources to conduct systematic reviews.
[13]
M. Campbell, J.E. McKenzie, A. Sowden, S.V. Katikireddi, S.E. Brennan, S. Ellis, et al.
Synthesis without meta-analysis (SWiM) in systematic reviews: reporting guideline.
BMJ, 368 (2020), pp. l6890
[14]
G.H. Guyatt, A.D. Oxman, G.E. Vist, R. Kunz, Y. Falck-Ytter, P. Alonso-Coello, et al.
GRADE Working Group. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations.
[15]
J.L. Aguayo-Albasini, B. Flores-Pastor, V. Soria-Aledo.
Sistema GRADE: clasificación de la calidad de la evidencia y graduación de la fuerza de la recomendación.
Cir Esp, 922 (2014), pp. 82-88
[16]
A. Liberati, D.G. Altman, J. Tetzlaff, C. Mulrow, P.C. Gøtzsche, J.P. Ioannidis, et al.
The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration.
J Clin Epidemiol, 62 (2009), pp. e1-e34
[17]
M. Vassar, M.J. Page, J. Glasbey, C. Cooper, A. Jorski, J. Sosio, et al.
Evaluation of the completeness of intervention reporting in Cochrane surgical systematic reviews using the TIDieR-SR checklist: a cross-sectional study.
BMJ Evid Based Med, 26 (2021), pp. 51-52

Please cite this article as: Roqué M, Urrútia G, von Elm E. La revisión sistemática y el metaanálisis en cirugía. Cir Esp. 2022;100:514–516.

Copyright © 2021. AEC
Descargar PDF
Opciones de artículo
es en pt

¿Es usted profesional sanitario apto para prescribir o dispensar medicamentos?

Are you a health professional able to prescribe or dispense drugs?

Você é um profissional de saúde habilitado a prescrever ou dispensar medicamentos