Chinese expert consensus on library establishment of laparoscopic or robotic surgical videos for the application research of artificial intelligence(2026 edition)

Expert Group for Surgical Quality Control and Evaluation, Chinese College of Surgeons, Chinese Medical Doctor Association, Expert Group for Professional Information Dissemination and Education, Chinese College of Surgeons,Chinese Medical Doctor Association

Chinese Journal of Practical Surgery ›› 2026, Vol. 46 ›› Issue (9) : 1178-1186.

PDF(1618 KB)
PDF(1618 KB)
Chinese Journal of Practical Surgery ›› 2026, Vol. 46 ›› Issue (9) : 1178-1186. DOI: 10.19538/j.cjps.issn1005-2208.2026.09.03

Chinese expert consensus on library establishment of laparoscopic or robotic surgical videos for the application research of artificial intelligence(2026 edition)

Author information +
History +

Cite this article

Download Citations
Expert Group for Surgical Quality Control and Evaluation, Chinese College of Surgeons, Chinese Medical Doctor Association , Expert Group for Professional Information Dissemination and Education, Chinese College of Surgeons,Chinese Medical Doctor Association. Chinese expert consensus on library establishment of laparoscopic or robotic surgical videos for the application research of artificial intelligence(2026 edition)[J]. Chinese Journal of Practical Surgery. 2026, 46(9): 1178-1186 https://doi.org/10.19538/j.cjps.issn1005-2208.2026.09.03

References

[1]
王伟, 张珂诚, 白雪冬, 等. 人工智能在胃肠外科应用现状与展望[J]. 中国实用外科杂志, 2020, 40(1): 38-41. DOI: 10.19538/j.cjps.issn1005-2208.2020.01.07.
[2]
Diamond IR, Grant RC, Feldman BM, et al. Defining consensus: A systematic review recommends methodologic criteria for reporting of Delphi studies[J]. J Clin Epidemiol, 2014, 67(4):401-409.DOI:10.1016/j.jclinepi.2013.12.002.
To investigate how consensus is operationalized in Delphi studies and to explore the role of consensus in determining the results of these studies.Systematic review of a random sample of 100 English language Delphi studies, from two large multidisciplinary databases [ISI Web of Science (Thompson Reuters, New York, NY) and Scopus (Elsevier, Amsterdam, NL)], published between 2000 and 2009.About 98 of the Delphi studies purported to assess consensus, although a definition for consensus was only provided in 72 of the studies (64 a priori). The most common definition for consensus was percent agreement (25 studies), with 75% being the median threshold to define consensus. Although the authors concluded in 86 of the studies that consensus was achieved, consensus was only specified a priori (with a threshold value) in 42 of these studies. Achievement of consensus was related to the decision to stop the Delphi study in only 23 studies, with 70 studies terminating after a specified number of rounds.Although consensus generally is felt to be of primary importance to the Delphi process, definitions of consensus vary widely and are poorly reported. Improved criteria for reporting of methods of Delphi studies are required.Copyright © 2014 Elsevier Inc. All rights reserved.
[3]
国家药品监督管理局. YY/T 1833.2-2022 人工智能医疗器械质量要求和评价第2部分:数据集通用要求[S]. 北京: 中国标准出版社, 2022.
[4]
国家药品监督管理局. YY/T 1833.3-2022 人工智能医疗器械质量要求和评价第3部分:数据标注通用要求[S]. 北京: 中国标准出版社, 2022.
[5]
中国信息通信研究院. 面向人工智能的数据治理(DG4AI)实践指南1.0[R]. 北京: 中国信息通信研究院, 2023.
[6]
国家新一代人工智能治理专业委员会. 新一代人工智能伦理规范[S/OL].(2021-09-25). https://www.most.gov.cn/kjbgz/202109/t20210926_177063.html.
[7]
Celentano V, Smart N, McGrath J, et al. LAP-VEGaS practice guidelines for reporting of educational videos in laparoscopic surgery: A joint trainers and trainees consensus statement[J]. Ann Surg, 2018, 268(6):920-926.DOI:10.1097/SLA.0000000000002725.
Consensus statement by an international multispecialty trainers and trainees expert committee on guidelines for reporting of educational videos in laparoscopic surgery.Instructive laparoscopy videos with appropriate exposition could be ideal for initial training in laparoscopic surgery, but there are no guidelines for video annotation or procedural educational and safety evaluation.Delphi questionnaire of 45 statements prepared by a steering group and voted on over 2 rounds by committee members using an electronic survey tool. Committee selection design included representative surgical training experts worldwide across different laparoscopic specialties, including general surgery, lower and upper gastrointestinal surgery, gynecology and urology, and a proportion of aligned surgical trainees.All 33 committee members completed both the first and the second round of the Delphi questionnaire related to 7 major domains: Video Introduction/Authors' information; Patient Details; Procedure Description; Procedure Outcome; Associated Educational Content; Peer Review; and Use in Educational Curriculae. The 17 statements that did not reach at least 80% agreement after the first round were revised and returned into the second round. The committee consensus approved 37 statements to at least an 82% agreement.Consensus guidelines on how to report laparoscopic surgery videos for educational purposes have been developed. We anticipate that following our guidelines could help to improve video quality.These reporting guidelines may be useful as a standard for reviewing videos submitted for publication or conference presentation.
[8]
Meireles OR, Rosman G, Altieri MS, et al. SAGES consensus recommendations on an annotation framework for surgical video[J]. Surg Endosc, 2021, 35(9):4918-4929.DOI:10.1007/s00464-021-08578-9.
The growing interest in analysis of surgical video through machine learning has led to increased research efforts; however, common methods of annotating video data are lacking. There is a need to establish recommendations on the annotation of surgical video data to enable assessment of algorithms and multi-institutional collaboration.Four working groups were formed from a pool of participants that included clinicians, engineers, and data scientists. The working groups were focused on four themes: (1) temporal models, (2) actions and tasks, (3) tissue characteristics and general anatomy, and (4) software and data structure. A modified Delphi process was utilized to create a consensus survey based on suggested recommendations from each of the working groups.After three Delphi rounds, consensus was reached on recommendations for annotation within each of these domains. A hierarchy for annotation of temporal events in surgery was established.While additional work remains to achieve accepted standards for video annotation in surgery, the consensus recommendations on a general framework for annotation presented here lay the foundation for standardization. This type of framework is critical to enabling diverse datasets, performance benchmarks, and collaboration.
[9]
Filicori F, Bitner DP, Fuchs HF, et al. SAGES video acquisition framework-analysis of available OR recording technologies by the SAGES AI task force[J]. Surg Endosc, 2023, 37(6):4321-4327.DOI:10.1007/s00464-022-09825-3.
Surgical video recording provides the opportunity to acquire intraoperative data that can subsequently be used for a variety of quality improvement, research, and educational applications. Various recording devices are available for standard operating room camera systems. Some allow for collateral data acquisition including activities of the OR staff, kinematic measurements (motion of surgical instruments), and recording of the endoscopic video streams. Additional analysis through computer vision (CV), which allows software to understand and perform predictive tasks on images, can allow for automatic phase segmentation, instrument tracking, and derivative performance-geared metrics. With this survey, we summarize available surgical video acquisition technologies and associated performance analysis platforms.In an effort promoted by the SAGES Artificial Intelligence Task Force, we surveyed the available video recording technology companies. Of thirteen companies approached, nine were interviewed, each over an hour-long video conference. A standard set of 17 questions was administered. Questions spanned from data acquisition capacity, quality, and synchronization of video with other data, availability of analytic tools, privacy, and access.Most platforms (89%) store video in full-HD (1080p) resolution at a frame rate of 30 fps. Most (67%) of available platforms store data in a Cloud-based databank as opposed to institutional hard drives. CV powered analysis is featured in some platforms: phase segmentation in 44% platforms, out of body blurring or tool tracking in 33%, and suture time in 11%. Kinematic data are provided by 22% and perfusion imaging in one device.Video acquisition platforms on the market allow for in depth performance analysis through manual and automated review. Most of these devices will be integrated in upcoming robotic surgical platforms. Platform analytic supplementation, including CV, may allow for more refined performance analysis to surgeons and trainees. Most current AI features are related to phase segmentation, instrument tracking, and video blurring.© 2023. The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.
[10]
Eckhoff JA, Rosman G, Altieri MS, et al. SAGES consensus recommendations on surgical video data use, structure,and exploration(for research in artificial intelligence,clinical quality improvement,and surgical education)[J]. Surg Endosc, 2023, 37(11):8690-8707.DOI:10.1007/s00464-023-10288-3.
Surgery generates a vast amount of data from each procedure. Particularly video data provides significant value for surgical research, clinical outcome assessment, quality control, and education. The data lifecycle is influenced by various factors, including data structure, acquisition, storage, and sharing; data use and exploration, and finally data governance, which encompasses all ethical and legal regulations associated with the data. There is a universal need among stakeholders in surgical data science to establish standardized frameworks that address all aspects of this lifecycle to ensure data quality and purpose.
[11]
Luo H, Xu G, Li C, et al. Real-time artificial intelligence for detection of upper gastrointestinal cancer by endoscopy: A multicentre,case-control,diagnostic study[J]. Lancet Oncol, 2019, 20(12):1645-1654.DOI:10.1016/S1470-2045(19)30637-0.
[12]
Yuan XL, Liu W, Lin YX, et al. Effect of an artificial intelligence-assisted system on endoscopic diagnosis of superficial oesophageal squamous cell carcinoma and precancerous lesions: A multicentre, tandem, double-blind, randomised controlled trial[J]. Lancet Gastroenterol Hepatol, 2024, 9(1):34-44.DOI:10.1016/S2468-1253(23)00276-5.
[13]
Wu L, Shang R, Sharma P, et al. Effect of a deep learning-based system on the miss rate of gastric neoplasms during upper gastrointestinal endoscopy: A single-centre,tandem, randomised controlled trial[J]. Lancet Gastroenterol Hepatol, 2021, 6(9):700-708.DOI:10.1016/S2468-1253(21)00216-8.
[14]
Wang P, Liu P, Glissen JR, et al. Lower adenoma miss rate of computer-aided detection-assisted colonoscopy vs routine white-light colonoscopy in a prospective tandem study[J]. Gastroenterology, 2020, 159(4):1252-1261.DOI:10.1053/j.gastro.2020.06.023.
Up to 30% of adenomas might be missed during screening colonoscopy-these could be polyps that appear on-screen but are not recognized by endoscopists or polyps that are in locations that do not appear on the screen at all. Computer-aided detection (CADe) systems, based on deep learning, might reduce rates of missed adenomas by displaying visual alerts that identify precancerous polyps on the endoscopy monitor in real time. We compared adenoma miss rates of CADe colonoscopy vs routine white-light colonoscopy.We performed a prospective study of patients, 18-75 years old, referred for diagnostic, screening, or surveillance colonoscopies at a single endoscopy center of Sichuan Provincial People's Hospital from June 3, 2019 through September 24, 2019. Same day, tandem colonoscopies were performed for each participant by the same endoscopist. Patients were randomly assigned to groups that received either CADe colonoscopy (n=184) or routine colonoscopy (n=185) first, followed immediately by the other procedure. Endoscopists were blinded to the group each patient was assigned to until immediately before the start of each colonoscopy. Polyps that were missed by the CADe system but detected by endoscopists were classified as missed polyps. False polyps were those continuously traced by the CADe system but then determined not to be polyps by the endoscopists. The primary endpoint was adenoma miss rate, which was defined as the number of adenomas detected in the second-pass colonoscopy divided by the total number of adenomas detected in both passes.The adenoma miss rate was significantly lower with CADe colonoscopy (13.89%; 95% CI, 8.24%-19.54%) than with routine colonoscopy (40.00%; 95% CI, 31.23%-48.77%, P<.0001). The polyp miss rate was significantly lower with CADe colonoscopy (12.98%; 95% CI, 9.08%-16.88%) than with routine colonoscopy (45.90%; 95% CI, 39.65%-52.15%) (P<.0001). Adenoma miss rates in ascending, transverse, and descending colon were significantly lower with CADe colonoscopy than with routine colonoscopy (ascending colon 6.67% vs 39.13%; P=.0095; transverse colon 16.33% vs 45.16%; P=.0065; and descending colon 12.50% vs 40.91%, P=.0364).CADe colonoscopy reduced the overall miss rate of adenomas by endoscopists using white-light endoscopy. Routine use of CADe might reduce the incidence of interval colon cancers. chictr.org.cn study no: ChiCTR1900023086.Copyright © 2020 AGA Institute. Published by Elsevier Inc. All rights reserved.
[15]
Chen M, Zhang B, Topatana W, et al. Classification and mutation prediction based on histopathology H&E images in liver cancer using deep learning[J]. NPJ Precis Oncol, 2020, 4:14.DOI:10.1038/s41698-020-0120-3.
[16]
Yang M, Zhao Y, Li C, et al. Multimodal integration of liquid biopsy and radiology for the noninvasive diagnosis of gallbladder cancer and benign disorders[J]. Cancer Cell, 2025, 43(3):398-412.DOI:10.1016/j.ccell.2025.02.011.
Gallbladder cancer (GBC) frequently mimics gallbladder benign lesions (GBBLs) in radiological images, leading to preoperative misdiagnoses. To address this challenge, we initiated a prospective, multicenter clinical trial (ChicCTR2100049249) and proposed a multimodal, non-invasive diagnostic model to distinguish GBC from GBBLs. A total of 301 patients diagnosed with gallbladder-occupying lesions (GBOLs) from 11 medical centers across 7 provinces in China were enrolled and divided into a discovery cohort and an independent external validation cohort. An artificial intelligence (AI)-based integrated model, GBCseeker, is created using cell-free DNA (cfDNA) genetic signatures, radiomic features, and clinical information. It achieves high accuracy in distinguishing GBC from GBBL patients (93.33% in the discovery cohort and 87.76% in the external validation cohort), reduces surgeons' diagnostic errors by 56.24%, and reclassifies GBOL patients into three categories to guide surgical options. Overall, our study establishes a tool for the preoperative diagnosis of GBC, facilitating surgical decision-making.Copyright © 2025 Elsevier Inc. All rights reserved.
[17]
Chen H, Gou L, Fang Z, et al. Artificial intelligence assisted real-time recognition of intra-abdominal metastasis during laparoscopic gastric cancer surgery[J]. NPJ Digit Med, 2025, 8(1):9.DOI:10.1038/s41746-024-01372-6.
Laparoscopic exploration (LE) is crucial for diagnosing intra-abdominal metastasis (IAM) in advanced gastric cancer (GC). However, overlooking single, tiny, and occult IAM lesions during LE can severely affect the treatment and prognosis due to surgeons' visual misinterpretations. To address this, we developed the artificial intelligence laparoscopic exploration system (AiLES) to recognize IAM lesions with various metastatic extents and locations. The AiLES was developed based on a dataset consisting of 5111 frames from 100 videos, using 4130 frames for model development and 981 frames for evaluation. The AiLES achieved a Dice score of 0.76 and a recognition speed of 11 frames per second, demonstrating robust performance in different metastatic extents (0.74-0.76) and locations (0.63-0.90). Furthermore, AiLES performed comparably to novice surgeons in IAM recognition and excelled in recognizing tiny and occult lesions. Our results demonstrate that the implementation of AiLES could enhance accurate tumor staging and assist individualized treatment decisions.© 2025. The Author(s).
[18]
Hu C, Xia Y, Zheng Z, et al. AI-based large-scale screening of gastric cancer from noncontrast CT imaging[J]. Nat Med, 2025, 31(9):3011-3019.DOI:10.1038/s41591-025-03785-6.
[19]
Vedula SS, Ghazi A, Collins JW, et al. Artificial intelligence methods and artificial intelligence-enabled metrics for surgical education: A multidisciplinary consensus[J]. J Am Coll Surg, 2022, 234(6):1181-1192.DOI:10.1097/XCS.0000000000000190.
Artificial intelligence (AI) methods and AI-enabled metrics hold tremendous potential to advance surgical education. Our objective was to generate consensus guidance on specific needs for AI methods and AI-enabled metrics for surgical education.
[20]
Kitaguchi D, Takeshita N, Matsuzaki H, et al. Development and validation of a 3-dimensional convolutional neural network for automatic surgical skill assessment based on spatiotemporal video analysis[J]. JAMA network open, 2021, 4(8):e2120786.DOI:10.1001/jamanetworkopen.2021.20786.
[21]
Fazlollahi AM, Bakhaidar M, Alsayegh A, et al. Effect of artificial intelligence tutoring vs expert instruction on learning simulated surgical skills among medical students: A randomized clinical trial[J]. JAMA network open, 2022, 5(2):e2149008.DOI:10.1001/jamanetworkopen.2021.49008.
[22]
Ng PY, Bing EG, Cuevas A, et al. Virtual reality and surgical oncology[J]. Ecancermedicalscience, 2023, 17:1525.DOI:10.3332/ecancer.2023.1525.
More than 80% of people diagnosed with cancer will require surgery. However, less than 5% have access to safe, affordable and timely surgery in low- and middle-income countries (LMICs) settings mostly due to the lack of trained workforce. Since its creation, virtual reality (VR) has been heralded as a viable adjunct to surgical training, but its adoption in surgical oncology to date is poorly understood. We undertook a systematic review to determine the application of VR across different surgical specialties, modalities and cancer pathway globally between January 2011 and 2021. We reviewed their characteristics and respective methods of validation of 24 articles. The results revealed gaps in application and accessibility of VR with a proclivity for high-income countries and high-risk, complex oncological surgeries. There is a lack of standardisation of clinical evaluation of VR, both in terms of clinical trials and implementation science. While all VR illustrated face and content validity, only around two-third exhibited construct validity and predictive validity was lacking overall. In conclusion, the asynchrony between VR development and actual global cancer surgery demand means the technology is not effectively, efficiently and equitably utilised to realise its surgical capacity-building potential. Future research should prioritise cost-effective VR technologies with predictive validity for high demand, open cancer surgeries required in LMICs.© the authors; licensee ecancermedicalscience.
[23]
Wu S, Chen Z, Liu R, et al. SurgSmart: An artificial intelligent system for quality control in laparoscopic cholecystectomy: An observational study[J]. Int J Surg, 2023, 109(5):1105-1114.DOI:10.1097/JS9.0000000000000329.
The rate of bile duct injury in laparoscopic cholecystectomy (LC) continues to be high due to low critical view of safety (CVS) achievement and the absence of an effective quality control system. The development of an intelligent system enables the automatic quality control of LC surgery and, eventually, the mitigation of bile duct injury. This study aims to develop an intelligent surgical quality control system for LC and using the system to evaluate LC videos and investigate factors associated with CVS achievement.
[24]
Dong Z, Cai J, Geng H, et al. Image-based deep learning model to predict stoma-site incisional hernia in patients with temporary ileostomy: A retrospective study[J]. iScience, 2024, 27(11):111235.DOI:10.1016/j.isci.2024.111235.
[25]
中国研究型医院学会放射学专业委员会, 上海市医学会放射专科分会. 3D可视化技术在肝胆外科中的临床应用专家共识(2022年版)[J]. 肿瘤影像学, 2023, 32(1):89-100.DOI:10.19732/j.cnki.2096-6210.2023.01.015.
[26]
Shi J, Cui R, Wang Z, et al. Deep learning HRNet FCN for blood vessel identification in laparoscopic pancreatic surgery[J]. NPJ Digit Med, 2025, 8(1):235.DOI:10.1038/s41746-025-01663-6.
Laparoscopic pancreatic surgery remains highly challenging due to the complexity of the pancreas and surrounding vascular structures, with risk of injuring critical blood vessels such as the Superior Mesenteric Vein (SMV)-Portal Vein (PV) axis and splenic vein. Here, we evaluated the High Resolution Network (HRNet)-Full Convolutional Network (FCN) model for its ability to accurately identify vascular contours and improve surgical safety. Using 12,694 images from 126 laparoscopic distal pancreatectomy (LDP) videos and 35,986 images from 138 Whipple procedure videos, the model demonstrated robust performance, achieving a mean Dice coefficient of 0.754, a recall of 85.00%, and a precision of 91.10%. By combining datasets from LDP and Whipple procedures, the model showed strong generalization across different surgical contexts and achieved real-time processing speeds of 11 frames per second during surgery process. These findings highlight HRNet-FCN's potential to recognize anatomical landmarks, enhance surgical precision, reduce complications, and improve laparoscopic pancreatic outcomes.© 2025. The Author(s).
[27]
Zeng X, Tao H, Dong Y, et al. Impact of three-dimensional reconstruction visualization technology on short-term and long-term outcomes after hepatectomy in patients with hepatocellular carcinoma: A propensity-score-matched and inverse probability of treatment-weighted multicenter study[J]. Int J Surg, 2024, 110(3):1663-1676.DOI:10.1097/JS9.0000000000001047.
Three-dimensional reconstruction visualization technology (3D-RVT) is an important tool in the preoperative assessment of patients undergoing liver resection. However, it is not clear whether this technique can improve short-term and long-term outcomes in patients with hepatocellular carcinoma (HCC) compared with two-dimensional (2D) imaging.
[28]
Madani A, Namazi B, Altieri MS, et al. Artificial intelligence for intraoperative guidance: Using semantic segmentation to identify surgical anatomy during laparoscopic cholecystectomy[J]. Ann Surg, 2022, 276(2):363-369.DOI:10.1097/SLA.0000000000004594.
The aim of this study was to develop and evaluate the performance of artificial intelligence (AI) models that can identify safe and dangerous zones of dissection, and anatomical landmarks during laparoscopic cholecystectomy (LC).
[29]
Saeidi H, Opfermann JD, Kam M, et al. Autonomous robotic laparoscopic surgery for intestinal anastomosis[J]. Sci Robot, 2022, 7(62):eabj2908.DOI:10.1126/scirobotics.abj2908.
[30]
Shademan A, Decker RS, Opfermann JD, et al. Supervised autonomous robotic soft tissue surgery[J]. Sci Transl Med, 2016, 8(337):337ra64.DOI:10.1126/scitranslmed.aad9398.
[31]
Brian JW, Chen JT, Hansen P, et al. SRT-H: A hierarchical framework for autonomous surgery via language-conditioned imitation learning[J]. Sci Robot, 2025, 10(104):eadt5254.DOI:10.1126/scirobotics.adt5254.
[32]
Moglia A, Georgiou K, Georgiou E, et al. A systematic review on artificial intelligence in robot-assisted surgery[J]. Int J Surg, 2021, 95:106151. DOI: 10.1016/j.ijsu.2021.106151.
[33]
复旦大学, 上海科学智能研究院. 科学智能白皮书2025[EB/OL]. (2025-01-01)[2026-02-18]. https://www.nature.com/collections/bfefgbacag.
[34]
Mascagni P, Alapatt D, Sestini L, et al. Computer vision in surgery: From potential to clinical value[J]. NPJ Digit Med, 2022, 5(1):163.DOI:10.1038/s41746-022-00707-5.
Hundreds of millions of operations are performed worldwide each year, and the rising uptake in minimally invasive surgery has enabled fiber optic cameras and robots to become both important tools to conduct surgery and sensors from which to capture information about surgery. Computer vision (CV), the application of algorithms to analyze and interpret visual data, has become a critical technology through which to study the intraoperative phase of care with the goals of augmenting surgeons' decision-making processes, supporting safer surgery, and expanding access to surgical care. While much work has been performed on potential use cases, there are currently no CV tools widely used for diagnostic or therapeutic applications in surgery. Using laparoscopic cholecystectomy as an example, we reviewed current CV techniques that have been applied to minimally invasive surgery and their clinical applications. Finally, we discuss the challenges and obstacles that remain to be overcome for broader implementation and adoption of CV in surgery.© 2022. The Author(s).
[35]
马闰卓, 苟龙飞, 余江, 等. 人工智能与手术动作识别:智能微创外科时代的手术技术评价新范式[J]. 中华消化外科杂志, 2025, 24(4):480-486.DOI:10.3760/cma.j.cn115610-20250309-00093.
[36]
Isensee F, Jaeger PF, Kohl SAA, et al. nnU-Net: A self-configuring method for deep learning-based biomedical image segmentation[J]. Nat Methods, 2021, 18(2):203-211.DOI:10.1038/s41592-020-01008-z.
Biomedical imaging is a driver of scientific discovery and a core component of medical care and is being stimulated by the field of deep learning. While semantic segmentation algorithms enable image analysis and quantification in many applications, the design of respective specialized solutions is non-trivial and highly dependent on dataset properties and hardware conditions. We developed nnU-Net, a deep learning-based segmentation method that automatically configures itself, including preprocessing, network architecture, training and post-processing for any new task. The key design choices in this process are modeled as a set of fixed parameters, interdependent rules and empirical decisions. Without manual intervention, nnU-Net surpasses most existing approaches, including highly specialized solutions on 23 public datasets used in international biomedical segmentation competitions. We make nnU-Net publicly available as an out-of-the-box tool, rendering state-of-the-art segmentation accessible to a broad audience by requiring neither expert knowledge nor computing resources beyond standard network training.
[37]
Ma J, He Y, Li F, et al. Segment anything in medical images[J]. Nat Commun, 2024, 15(1): 654. DOI: 10.1038/s41467-024-44824-z.
Medical image segmentation is a critical component in clinical practice, facilitating accurate diagnosis, treatment planning, and disease monitoring. However, existing methods, often tailored to specific modalities or disease types, lack generalizability across the diverse spectrum of medical image segmentation tasks. Here we present MedSAM, a foundation model designed for bridging this gap by enabling universal medical image segmentation. The model is developed on a large-scale medical image dataset with 1,570,263 image-mask pairs, covering 10 imaging modalities and over 30 cancer types. We conduct a comprehensive evaluation on 86 internal validation tasks and 60 external validation tasks, demonstrating better accuracy and robustness than modality-wise specialist models. By delivering accurate and efficient segmentation across a wide spectrum of tasks, MedSAM holds significant potential to expedite the evolution of diagnostic tools and the personalization of treatment plans.© 2024. The Author(s).
[38]
Nath V, Yang D, et al. Vila-m3:Enhancing vision-language models with medical expert knowledge[J/OL]. arXiv preprint arXiv: 2411.12915.(2024-11-20). https://arxiv.org/abs/2411.12915.
[39]
Zhang J, Budhdeo S, William W, et al. Moving towards vertically integrated artificial intelligence development[J]. NPJ Digit Med, 2022, 5(1):143.DOI:10.1038/s41746-022-00690-x.
Substantial interest and investment in clinical artificial intelligence (AI) research has not resulted in widespread translation to deployed AI solutions. Current attention has focused on bias and explainability in AI algorithm development, external validity and model generalisability, and lack of equity and representation in existing data. While of great importance, these considerations also reflect a model-centric approach seen in published clinical AI research, which focuses on optimising architecture and performance of an AI model on best available datasets. However, even robustly built models using state-of-the-art algorithms may fail once tested in realistic environments due to unpredictability of real-world conditions, out-of-dataset scenarios, characteristics of deployment infrastructure, and lack of added value to clinical workflows relative to cost and potential clinical risks. In this perspective, we define a vertically integrated approach to AI development that incorporates early, cross-disciplinary, consideration of impact evaluation, data lifecycles, and AI production, and explore its implementation in two contrasting AI development pipelines: a scalable "AI factory" (Mayo Clinic, Rochester, United States), and an end-to-end cervical cancer screening platform for resource poor settings (Paps AI, Mbarara, Uganda). We provide practical recommendations for implementers, and discuss future challenges and novel approaches (including a decentralised federated architecture being developed in the NHS (AI4VBH, London, UK)). Growth in global clinical AI research continues unabated, and introduction of vertically integrated teams and development practices can increase the translational potential of future clinical AI projects.© 2022. The Author(s).
[40]
Vaught J. Biobanking comes of age: The transition to biospecimen science[J]. Annu Rev Pharmacol Toxicol, 2016, 56:211-228.DOI:10.1146/annurev-pharmtox-010715-103246.
Biobanking involves the collection, processing, storage, and distribution of biological specimens and the policies and procedures necessary to accomplish those aims successfully. Although biobanking may also involve collections for environmental studies or museum archives, most efforts to standardize biobanking practices have been directed toward human biomedical research. Initially focused primarily on collecting samples for diagnostic purposes in pathology settings, biobanks have evolved into complex organizations engaged in advancing personalized (or precision) medicine and translational research. This evolution has involved the development of biobanking best practices and the transformation of a field driven by empirical approaches into the emerging area of biospecimen science. It has become increasingly important to develop evidence-based practices for collecting biospecimens and data that can be shared with confidence with international collaborators. Aside from these technical approaches, other factors play crucial roles, such as ethical and regulatory issues, business planning and sustainability, and approaches to data collection and sharing.
[41]
Ferhatoglu MF, Kartal A, Filiz Aİ, et al. Comparison of new Era's education platforms, youtube® and websurg®,in sleeve gastrectomy[J]. Obes Surg, 2019, 29(11):3472-3477.DOI:10.1007/s11695-019-04008-x.
The Internet is a widely used resource for obtaining medical information. However, the quality of information on online platforms is still debated. Our goal in this quality-controlled WebSurg® and YouTube®-based study was to compare these two online video platforms in terms of the accuracy and quality of information about sleeve gastrectomy videos.Most viewed (popular) videos returned by YouTube® search engine in response to the keyword "sleeve gastrectomy" were included in the study. The educational accuracy and quality of the videos were evaluated according to known scoring systems. A novel scoring system measured technical quality. The ten most viewed (popular) videos in WebSurg® in response to the keyword "sleeve gastrectomy" were compared with ten YouTube® videos with the highest educational/technical scores.Scoring systems measuring the educational accuracy and quality of WebSurg® videos were significantly higher than ten YouTube® videos which have the most top technical scores (p < 0.05), and no significant difference was found in the assessment of ten YouTube® videos that have the highest technical ratings compared with WebSurg® videos (p 0.481).WebSurg® videos, which were passed through a reviewing process and were mostly prepared by academicians, remained below the expected quality. The main limitation of WebSurg® and YouTube® is the lack of information on preoperative and postoperative processes.
[42]
Acero N, Herrero E, Foncham J, et al. Accuracy,quality,and misinformation of youtube abortion procedural videos: Cross-sectional study[J]. J Med Internet Res, 2024, 26:e50099.DOI:10.2196/50099.
The internet is often the first source patients turn to for medical information. YouTube is a commonly used internet-based resource for patients seeking to learn about medical procedures, including their risks, benefits, and safety profile. Abortion is a common yet polarizing medical procedure. People interested in obtaining an abortion are likely to use the internet to learn more about abortion procedures and may encounter misinformed and biased information. This is troubling as information found on the internet can significantly alter perceptions and understanding of these procedures. There is no current research that evaluates the accuracy, quality, and misinformation of instructional abortion videos available to patients.
[43]
Stauder R, Kranzfelder M, et al. The TUM LapChole dataset for the M2CAI 2016 workflow challenge[J/OL]. arXiv preprint arXiv: 1610.09278.(2016-10-31). https://arxiv.org/abs/1610.09278.
[44]
Twinanda AP, Marescaux J, et al. Single-and multi-task architectures for surgical workflow challenge at M2CAI 2016[J/OL]. arXiv preprint arXiv: 1610.08844.(2016-10-31). https://arxiv.org/abs/1610.08844.
[45]
Gou L, Wu H, Chen C, et al. Dynamic key vascular anatomy dataset for D2 lymph node dissection during laparoscopic gastric cancer surgery[J]. Sci Data, 2025, 12(1):903.DOI:10.1038/s41597-025-05255-7.
[46]
Wilkinson MD, Dumontier M, Aalbersberg IJ, et al. The FAIR guiding principles for scientific data management and stewardship[J]. Sci Data, 2016, 3:160018.DOI:10.1038/sdata.2016.18.
There is an urgent need to improve the infrastructure supporting the reuse of scholarly data. A diverse set of stakeholders—representing academia, industry, funding agencies, and scholarly publishers—have come together to design and jointly endorse a concise and measureable set of principles that we refer to as the FAIR Data Principles. The intent is that these may act as a guideline for those wishing to enhance the reusability of their data holdings. Distinct from peer initiatives that focus on the human scholar, the FAIR Principles put specific emphasis on enhancing the ability of machines to automatically find and use the data, in addition to supporting its reuse by individuals. This Comment is the first formal publication of the FAIR Principles, and includes the rationale behind them, and some exemplar implementations in the community.
[47]
Office of the Secretary, HHS. Administrative simplification: adoption of a standard for a unique health plan identifier; addition to the National Provider Identifier requirements; and a change to the compliance date for the International Classification of Diseases, 10th Edition (ICD-10-CM and ICD-10-PCS) medical data code sets: final rule[J]. Fed Regist, 2012, 77(172):54663-54720. PMID: 22950146.
[48]
Millar J. The need for a global language - SNOMED CT introduction[J]. Stud Health Technol Inform, 2016, 225: 683-685. DOI: 10.3233/978-1-61499-658-3-683.
SNOMED CT is the most comprehensive, multilingual clinical healthcare terminology in the world. It is a resource with comprehensive, scientifically validated clinical content. SNOMED CT enables consistent, processable representation of clinical content in electronic health records. When implemented in software applicationsSNOMED CT can be used to represent clinically relevant information consistently, reliabl comprehensively as an integral part of producing electronic health information. SNOMED CT supports the development of comprehensive high-quality clinical content in health records. It provides a standardized way to represent clinical phrases captured by the healthcare professional and enables automatic interpretation of these. SNOMED CT is a clinically validated, semantically rich, controlled vocabulary that facilitates evolutionary growth in expressivity to meet emerging requirements. SNOMED CT based clinical information benefits individual patients and clinicians as well as populations and it supports evidence based care. The use of an Electronic Health Record (EHR) improves communication and increases the availability of relevant information. IHTSDO works with other standards oganisations to ensure interoperability and a key area has been the work with ICN to enable the use of ICNP and SNOMED CT by the nursing profession internationally.
[49]
Gibaud B, Forestier G, Feldmann C, et al. Toward a standard ontology of surgical process models[J]. Int J Comput Assist Radiol Surg, 2018, 13(9):1397-1408.DOI:10.1007/s11548-018-1824-5.
The development of common ontologies has recently been identified as one of the key challenges in the emerging field of surgical data science (SDS). However, past and existing initiatives in the domain of surgery have mainly been focussing on individual groups and failed to achieve widespread international acceptance by the research community. To address this challenge, the authors of this paper launched a European initiative-OntoSPM Collaborative Action-with the goal of establishing a framework for joint development of ontologies in the field of SDS. This manuscript summarizes the goals and the current status of the international initiative.A workshop was organized in 2016, gathering the main European research groups having experience in developing and using ontologies in this domain. It led to the conclusion that a common ontology for surgical process models (SPM) was absolutely needed, and that the existing OntoSPM ontology could provide a good starting point toward the collaborative design and promotion of common, standard ontologies on SPM.The workshop led to the OntoSPM Collaborative Action-launched in mid-2016-with the objective to develop, maintain and promote the use of common ontologies of SPM relevant to the whole domain of SDS. The fundamental concept, the architecture, the management and curation of the common ontology have been established, making it ready for wider public use.The OntoSPM Collaborative Action has been in operation for 24 months, with a growing dedicated membership. Its main result is a modular ontology, undergoing constant updates and extensions, based on the experts' suggestions. It remains an open collaborative action, which always welcomes new contributors and applications.
[50]
Sasaki K, Ito M, Kobayashi S, et al. Automated surgical workflow identification by artificial intelligence in laparoscopic hepatectomy: Experimental research[J]. Int J Surg, 2022, 105:106856.DOI:10.1016/j.ijsu.2022.106856.
[51]
Kitaguchi D, Takeshita N, Matsuzaki H, et al. Automated laparoscopic colorectal surgery workflow recognition using artificial intelligence: Experimental research[J]. Int J Surg, 2020, 79:88-94.DOI:10.1016/j.ijsu.2020.05.015.
Identifying laparoscopic surgical videos using artificial intelligence (AI) facilitates the automation of several currently time-consuming manual processes, including video analysis, indexing, and video-based skill assessment. This study aimed to construct a large annotated dataset comprising laparoscopic colorectal surgery (LCRS) videos from multiple institutions and evaluate the accuracy of automatic recognition for surgical phase, action, and tool by combining this dataset with AI.A total of 300 intraoperative videos were collected from 19 high-volume centers. A series of surgical workflows were classified into 9 phases and 3 actions, and the area of 5 tools were assigned by painting. More than 82 million frames were annotated for a phase and action classification task, and 4000 frames were annotated for a tool segmentation task. Of these frames, 80% were used for the training dataset and 20% for the test dataset. A convolutional neural network (CNN) was used to analyze the videos. Intersection over union (IoU) was used as the evaluation metric for tool recognition.The overall accuracies for the automatic surgical phase and action classification task were 81.0% and 83.2%, respectively. The mean IoU for the automatic tool segmentation task for 5 tools was 51.2%.A large annotated dataset of LCRS videos was constructed, and the phase, action, and tool were recognized with high accuracy using AI. Our dataset has potential uses in medical applications such as automatic video indexing and surgical skill assessments. Open research will assist in improving CNN models by making our dataset available in the field of computer vision.Copyright © 2020 IJS Publishing Group Ltd. Published by Elsevier Ltd. All rights reserved.
[52]
Hashimoto DA, Rosman G, Witkowski ER, et al. Computer vision analysis of intraoperative video: Automated recognition of operative steps in laparoscopic sleeve gastrectomy[J]. Ann Surg, 2019, 270(3):414-421.DOI:10.1097/SLA.0000000000003460.
To develop and assess AI algorithms to identify operative steps in laparoscopic sleeve gastrectomy (LSG).Computer vision, a form of artificial intelligence (AI), allows for quantitative analysis of video by computers for identification of objects and patterns, such as in autonomous driving.Intraoperative video from LSG from an academic institution was annotated by 2 fellowship-trained, board-certified bariatric surgeons. Videos were segmented into the following steps: 1) port placement, 2) liver retraction, 3) liver biopsy, 4) gastrocolic ligament dissection, 5) stapling of the stomach, 6) bagging specimen, and 7) final inspection of staple line. Deep neural networks were used to analyze videos. Accuracy of operative step identification by the AI was determined by comparing to surgeon annotations.Eighty-eight cases of LSG were analyzed. A random 70% sample of these clips was used to train the AI and 30% to test the AI's performance. Mean concordance correlation coefficient for human annotators was 0.862, suggesting excellent agreement. Mean (±SD) accuracy of the AI in identifying operative steps in the test set was 82% ± 4% with a maximum of 85.6%.AI can extract quantitative surgical data from video with 85.6% accuracy. This suggests operative video could be used as a quantitative data source for research in intraoperative clinical decision support, risk prediction, or outcomes studies.
[53]
张珂诚, 乔治, 杨力, 等. 计算机视觉人工智能技术在腹腔镜胃癌根治术中对器械和脏器的检测识别:一项多中心临床研究[J]. 中华胃肠外科杂志, 2024, 27(5):464-470.DOI:10.3760/cma.j.cn441530-20240125-00041.
[54]
Une N, Kobayashi S, Kitaguchi D, et al. Intraoperative artificial intelligence system identifying liver vessels in laparoscopic liver resection: A retrospective experimental study[J]. Surg Endosc, 2024, 38(2):1088-1095.DOI:10.1007/s00464-023-10637-2.
[55]
Tao H, Li B, Zeng X, et al. Artificial intelligence-based anatomy recognition in laparoscopic hepatectomy: Multicentre study[J]. Br J Surg, 2024, 111(10):znae254.DOI:10.1093/bjs/znae254.
[56]
Shi Y, Zhang G, Ma C, et al. Machine learning algorithms to predict intraoperative hemorrhage in surgical patients: A modeling study of real-world data in Shanghai,China[J]. BMC Med Inform Decis Mak, 2023, 23(1):156.DOI:10.1186/s12911-023-02253-w.
Prediction tools for various intraoperative bleeding events remain scarce. We aim to develop machine learning-based models and identify the most important predictors by real-world data from electronic medical records (EMRs).
[57]
Cocca S, Pontillo G, Grande G, et al. Artificial intelligence in detection of small bowel lesions and their bleeding risk: A new step forward[J]. World J Gastroenterol, 2024, 30(18):2482-2484.DOI:10.3748/wjg.v30.i18.2482.
The present letter to the editor is related to the study with the title “Automatic detection of small bowel (SB) lesions with different bleeding risk based on deep learning models”. Capsule endoscopy (CE) is the main tool to assess SB diseases but it is a time-consuming procedure with a significant error rate. The development of artificial intelligence (AI) in CE could simplify physicians’ tasks. The novel deep learning model by Zhang et al seems to be able to identify various SB lesions and their bleeding risk, and it could pave the way to next perspective studies to better enhance the diagnostic support of AI in the detection of different types of SB lesions in clinical practice.
[58]
Twinanda AP, Shehata S, Mutter D, et al. EndoNet: A deep architecture for recognition tasks on laparoscopic videos[J]. IEEE Trans Med Imaging, 2017, 36(1):86-97.DOI:10.1109/TMI.2016.2593957.
[59]
Vazirani AA, O’Donoghue O, Brindley D, et al. Blockchain vehicles for efficient medical record management[J]. NPJ Digital Medicine, 2020, 3(1): 1.DOI:10.1038/s41746-019-0211-0.
The lack of interoperability in Britain’s medical records systems precludes the realisation of benefits generated by increased spending elsewhere in healthcare. Growing concerns regarding the security of online medical data following breaches, and regarding regulations governing data ownership, mandate strict parameters in the development of efficient methods to administrate medical records. Furthermore, consideration must be placed on the rise of connected devices, which vastly increase the amount of data that can be collected in order to improve a patient’s long-term health outcomes. Increasing numbers of healthcare systems are developing Blockchain-based systems to manage medical data. A Blockchain is a decentralised, continuously growing online ledger of records, validated by members of the network. Traditionally used to manage cryptocurrency records, distributed ledger technology can be applied to various aspects of healthcare. In this manuscript, we focus on how Electronic Medical Records in particular can be managed by Blockchain, and how the introduction of this novel technology can create a more efficient and interoperable infrastructure to manage records that leads to improved healthcare outcomes, while maintaining patient data ownership and without compromising privacy or security of sensitive data.

Footnotes

利益冲突 所有参与本共识编写人员均声明不存在利益冲突

Funding

Noncommunicable Chronic Diseases-National Science and Technology Major Project, Sub-Project(2024ZD0520304)
Shanghai Municipal Education Commission(JWAIZD-6)
Fundamental Research Funds for the Central Universities(YG2026ZD30)
PDF(1618 KB)

Accesses

Citation

Detail

Sections
Recommended

/

〈 〉