基于器械识别的腹腔镜胃癌根治术流程解析及质量控制研究

张亮, 魏亚明, 时林森, 闫军, 龚龙波, 管文贤

中国实用外科杂志 ›› 2026, Vol. 46 ›› Issue (7) : 960-968.

PDF(28484 KB)
PDF(28484 KB)
中国实用外科杂志 ›› 2026, Vol. 46 ›› Issue (7) : 960-968. DOI: 10.19538/j.cjps.issn1005-2208.2026.07.18
论著

基于器械识别的腹腔镜胃癌根治术流程解析及质量控制研究

作者信息 +

Process reconstruction and quality control of laparoscopic radical gastrectomy based on surgical instrument recognition

Author information +
文章历史 +

摘要

目的 构建融合实例分割与多目标追踪的人工智能手术流程解析体系,实现手术视频自动化结构化解析与客观质量评估。方法 回顾性分析2022年1月至2023年12月徐州市中心医院胃肠外科、南京大学医学院附属鼓楼医院普外科及苏州大学附属第四医院普外科实施的20例腹腔镜胃癌根治术的手术视频资料,共提取标注 7569 张含 11 类手术器械及术中出血区域的图像,按 8∶2 分层划分训练、验证数据集;基于 YOLO11L-seg 模型开展迁移学习,结合 ByteTrack 算法完成器械时序追踪,从内部静态图像、外部独立动态手术视频、外科医师盲评3个维度验证模型效能,评价指标包含交并比阈值为0.5时的边界框平均精度均值(mAP@0.5)、掩码(Mask)mAP@0.5、准确率、F1/Dice 系数;依托器械时序使用频率构建手术流程热图,量化区分不同术式、定位关键手术步骤。结果 模型内部静态验证边界框mAP@0.5 为 83.5%,掩码mAP@0.5 为 82.8%;外部动态视频测试集整体识别准确率 92.2%,F1/Dice 系数 0.878,术中出血识别准确率达 100%;手术热图可完全区分远端胃切除术、全胃切除术、近端胃切除术 3 种术式,关键操作步骤定位准确率>90%;单例手术视频智能审核时长较人工缩短约70%。3名高年资外科医师盲评显示器械、出血识别及术式判别准确率为100%。结论 基于 YOLO11L-seg 与 ByteTrack 的器械识别追踪方案可精准解析腹腔镜胃癌根治术时序流程,手术热图可直观量化手术操作特征,为微创手术自动化、标准化质量管控提供可行技术方案。

Abstract

Objective To construct an artificial intelligence surgical workflow reconstruction system integrating instance segmentation and multi-object tracking to realize automatic structural analysis and objective quality evaluation of surgical videos. Methods A total of 20 videos of laparoscopic radical gastrectomy performed between January 2022 and December 2023 at the Department of Gastrointestinal Surgery Xuzhou Central Hospital; the Department of General Surgery, Nanjing Drum Tower Hospital, the Affiliated Hospital of Nanjing University Medical School; and the Department of General Surgery, the Fourth Affiliated Hospital of Soochow University were retrospectively analyzed. A total of 7569 images annotated with 11 types of surgical instruments and intraoperative bleeding areas were extracted and divided into training and validation datasets at a ratio of 8:2. Transfer learning was performed based on the YOLO11L-seg model, and the ByteTrack algorithm was integrated for temporal tracking of surgical instruments. Model performance was verified from three dimensions: internal static image validation, external independent dynamic surgical video validation, and blind evaluation by clinical surgeons. Evaluation metrics included mAP@0.5, mask mAP@0.5, recognition accuracy, and F1/Dice coefficient. A surgical procedure heatmap was generated based on the temporal frequency of instrument usage to quantitatively distinguish different surgical procedures and locate key operative steps. Results In the internal static validation, the box mAP@0.5 and mask mAP@0.5 of the model reached 83.5% and 82.8%, respectively. In the external dynamic video test set, the overall recognition accuracy was 92.2% with an F1/Dice coefficient of 0.878, and the recognition accuracy of intraoperative bleeding was 100%. The surgical heatmap could completely distinguish three radical gastrectomy procedures including distal, total and proximal gastrectomy, and the localization accuracy of key operative steps exceeded 90%. The intelligent review time of a single surgical video was reduced by approximately 70% compared with manual review. Blind evaluation by three senior surgeons demonstrated an average accuracy of 100% in instrument identification, bleeding detection and surgical procedure classification. Conclusion The instrument recognition and tracking scheme based on YOLO11L-seg and ByteTrack can accurately reconstruct the temporal workflow of laparoscopic radical gastrectomy. The surgical heatmap can intuitively quantify surgical operation characteristics, providing a feasible technical strategy for automatic and standardized quality control of minimally invasive surgery.

关键词

腹腔镜胃癌根治术 / 手术器械识别 / YOLO11L-seg模型 / ByteTrack算法 / 计算机视觉

Key words

laparoscopic radical gastrectomy / surgical instrument recognition / YOLO11L-seg model / ByteTrack algorithm / computer vision

引用本文

导出引用
张亮, 魏亚明, 时林森, . 基于器械识别的腹腔镜胃癌根治术流程解析及质量控制研究[J]. 中国实用外科杂志. 2026, 46(7): 960-968 https://doi.org/10.19538/j.cjps.issn1005-2208.2026.07.18
ZHANG Liang, WEI Ya-ming, SHI Lin-sen, et al. Process reconstruction and quality control of laparoscopic radical gastrectomy based on surgical instrument recognition[J]. Chinese Journal of Practical Surgery. 2026, 46(7): 960-968 https://doi.org/10.19538/j.cjps.issn1005-2208.2026.07.18
中图分类号: R6   

参考文献

[1]
Lai M, Li Y, Lan N, et al. Cost-effectiveness of open vs. laparoscopic gastrectomy for locally advanced gastric cancer in China[J]. Sci Rep, 2025, 15(1): 6714. DOI: 10.1038/s41598-025-91003-1.
[2]
Ding Y, Liu X, Cai Y, et al. Impact of intraoperative explanation combined with surgical video review on anatomy learning in laparoscopic distal gastrectomy[J]. BMJ Open, 2025, 15(9): e097581. DOI: 10.1136/bmjopen-2024-097581.
[3]
Rueckert T, Rauber D, Maerkl R, et al. Comparative validation of surgical phase recognition, instrument keypoint estimation, and instrument instance segmentation in endoscopy: Results of the PhaKIR 2024 challenge[J]. Med Image Anal, 2026, 109:103945. DOI: 10.1016/j.media.2026.103945.
[4]
周哲琦, 等. 艾克拜尔·艾力,艾尔肯·乌马尔, 计算机视觉人工智能模型在胃袖状切除联合胃底折叠及同期行食管裂孔疝修补术中应用研究[J]. 中国实用外科杂志, 2026, 46(3): 368-375. DOI: 10.19538/j.cjps.issn1005-2208.2026.03.14.
[5]
Carstens M, Vasisht S, Zhang Z, et al. Artificial intelligence for surgical scene understanding: A systematic review and reporting quality meta-analysis[J]. NPJ Digit Med, 2025, 9(1): 59. DOI: 10.1038/s41746-025-02227-4.
[6]
Yang C, Zhao Z, Hu S. Image-based laparoscopic tool detection and tracking using convolutional neural networks: a review of the literature[J]. Comput Assist Surg (Abingdon), 2020, 25(1): 15-28. DOI: 10.1080/24699322.2020.1801842.
[7]
Peng ZY, Wang ZB, Yan Y, et al. Development of an AI-driven digital assistance system for real-time safety evaluation and quality control in laparoscopic liver surgery[J]. Front Oncol, 2025, 15:1678525. DOI: 10.3389/fonc.2025.1678525.
[8]
Zhao B, Zhao J, Song R, et al. Enhanced YOLO11 for lightweight and accurate drone-based maritime search and rescue object detection[J]. PLoS One, 2025, 20(7): e0321920. DOI: 10.1371/journal.pone.0321920.
[9]
Kumazu Y, Kobayashi N, Kitamura N, et al. Automated segmentation by deep learning of loose connective tissue fibers to define safe dissection planes in robot-assisted gastrectomy[J]. Sci Rep, 2021, 11(1): 21198. DOI: 10.1038/s41598-021-00557-3.
[10]
Mascagni P, Alapatt D, Sethi R, et al. Computer vision in surgery: State of the art in surgical video analysis[J]. Ann Surg, 2021, 274(6): e1237-e1246. DOI: .1097/SLA.000000005120
[11]
Komatsu M, Kitaguchi D, Yura M, et al. Automatic surgical phase recognition-based skill assessment in laparoscopic distal gastrectomy using multicenter videos[J]. Gastric Cancer, 2024, 27(1): 187-196. DOI: 10.1007/s10120-023-01450-w.
[12]
Yamazaki Y, Kanaji S, Matsuda T, et al. Automated surgical instrument detection from laparoscopic gastrectomy video images using an open source convolutional neural network platform[J]. J Am Coll Surg, 2020, 230(5): 725-732e721. DOI: 10.1016/j.jamcollsurg.2020.01.037.

脚注

利益冲突 所有作者均声明不存在利益冲突

基金

国家自然科学基金项目(82573572)

PDF(28484 KB)

Accesses

Citation

Detail

段落导航
相关文章

/