Interobserver agreement for contrast-enhanced ultrasound of liver imaging reporting and data system: A systematic review and meta-analysis

Jun Li; Ming Chen; Zi-Jing Wang; Shu-Gang Li; Meng Jiang; Long Shi; Chun-Li Cao; Tian Sang; Xin-Wu Cui; Christoph F Dietrich

doi:10.12998/wjcc.v8.i22.5589

Interobserver agreement for contrast-enhanced ultrasound of liver imaging reporting and data system: A systematic review and meta-analysis

World J Clin Cases. 2020 Nov 26;8(22):5589-5602. doi: 10.12998/wjcc.v8.i22.5589.

Authors

Jun Li¹, Ming Chen¹, Zi-Jing Wang¹, Shu-Gang Li², Meng Jiang³, Long Shi⁴, Chun-Li Cao¹, Tian Sang¹, Xin-Wu Cui⁵, Christoph F Dietrich⁶

Affiliations

¹ Department of Medical Ultrasound, The First Affiliated Hospital of Medical College, Shihezi University, Shihezi 832008, Xinjiang Uygur Autonomous Region, China.
² Department of Child, Adolescent Health and Maternal Health, School of Public Health, Capital Medical University, Beijing 100069, Beijing, China.
³ Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430030, Hubei Province, China.
⁴ Department of Medical Ultrasound, The Second People's Hospital of Jiangmen, Jingmen 448000, Hubei Province, China.
⁵ Department of Medical Ultrasound, Sino-German Tongji-Caritas Research Center of Ultrasound in Medicine, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430030, Hubei Province, China. cuixinwu@live.cn.
⁶ Department of Internal Medicine, Hirslanden Clinic, Berne 27804, Switzerland.

Abstract

Background: Hepatocellular carcinoma is the most common primary liver malignancy. From the results of previous studies, Liver Imaging Reporting and Data System (LI-RADS) on contrast-enhanced ultrasound (CEUS) has shown satisfactory diagnostic value. However, a unified conclusion on the interobserver stability of this innovative ultrasound imaging has not been determined. The present meta-analysis examined the interobserver agreement of CEUS LI-RADS to provide some reference for subsequent related research.

Aim: To evaluate the interobserver agreement of LI-RADS on CEUS and analyze the sources of heterogeneity between studies.

Methods: Relevant papers on the subject of interobserver agreement on CEUS LI-RADS published before March 1, 2020 in China and other countries were analyzed. The studies were filtered, and the diagnostic criteria were evaluated. The selected references were analyzed using the "meta" and "metafor" packages of R software version 3.6.2.

Results: Eight studies were ultimately included in the present analysis. Meta-analysis results revealed that the summary Kappa value of included studies was 0.76 [95% confidence interval, 0.67-0.83], which shows substantial agreement. Higgins I ² statistics also confirmed the substantial heterogeneity (I ² = 91.30%, 95% confidence interval, 85.3%-94.9%, P < 0.01). Meta-regression identified the variables, including the method of patient enrollment, method of consistency testing, and patient race, which explained the substantial study heterogeneity.

Conclusion: CEUS LI-RADS demonstrated overall substantial interobserver agreement, but heterogeneous results between studies were also obvious. Further clinical investigations should consider a modified recommendation about the experimental design.

Keywords: Contrast-enhanced ultrasound; Diagnosis; Interobserver agreement; Liver imaging reporting and data system; Meta-analysis; Systematic review.