百科.dev
全部条目在线工具AI 编程趋势榜开源项目技术资讯提交条目
登录
< 返回工具列表
S

SegVol

> 编程语言
开源

"SegVol: 通用和交互式体积医学图像分割"的官方代码。

386 stars0 点赞1 次浏览
访问官网GitHub

工具介绍

"SegVol: 通用和交互式体积医学图像分割"的官方代码。

SegVol: Universal and Interactive Volumetric Medical Image Segmentation

Our paper has been accepted at NeurIPS 2024 as a spotlight!

SegVol repo for CVPR SegFM

The SegVol is a universal and interactive model for volumetric medical image segmentation. SegVol accepts point, box and text prompt while output volumetric segmentation. By training on 90k unlabeled Computed Tomography (CT) volumes and 6k labeled CTs, this foundation model supports the segmentation of over 200 anatomical categories.

We have released SegVol's inference code, training code, model params and ViT pre-training params (pre-training is performed over 2,000 epochs on 96k CTs).

Keywords: 3D medical SAM, volumetric image segmentation

Quickstart: Enable easy training and testing

Quickstart with ModelScope (无需代理)

Quickstart with HuggingFace

Start with source code

Requirements

The pytorch v1.11.0 (or a higher version) is needed first. Following install key requirements using commands:

bash
pip install 'monai[all]==0.9.0'
pip install einops==0.6.1
pip install transformers==4.18.0
pip install matplotlib

Guideline for training and inference

How to infer a demo case.

How to train SegVol.

How to use our pre-trained ViT as your model encoder.

Datasets involved

The 25 processed datasets are being uploaded to ModelScope/魔搭社区 and HuggingFace.

Links to the original datasets:

Dataset Link
3D-IRCADB https://www.kaggle.com/datasets/nguyenhoainam27/3dircadb
AbdomenCT-1k https://github.com/JunMa11/AbdomenCT-1K
AMOS22 https://amos22.grand-challenge.org/
BTCV https://www.synapse.org/\#!Synapse:syn3193805/wiki/217752
CHAOS https://chaos.grand-challenge.org/
CT-ORG https://wiki.cancerimagingarchive.net/pages/viewpage.action?pageId=61080890
FLARE22 https://flare22.grand-challenge.org/
HaN-Seg https://han-seg2023.grand-challenge.org/
KiPA22 https://kipa22.grand-challenge.org/
KiTS19 https://kits19.grand-challenge.org/
KiTS23 https://kits-challenge.org/kits23/
LUNA16 https://luna16.grand-challenge.org/Data/
MSD-Colon http://medicaldecathlon.com/
MSD-HepaticVessel http://medicaldecathlon.com/
MSD-Liver http://medicaldecathlon.com/
MSD-lung http://medicaldecathlon.com/
MSD-pancreas http://medicaldecathlon.com/
MSD-spleen http://medicaldecathlon.com/
Pancreas-CT https://wiki.cancerimagingarchive.net/display/public/pancreas-ct
QUBIQ https://qubiq.grand-challenge.org/
SLIVER07 https://sliver07.grand-challenge.org/
TotalSegmentator https://github.com/wasserth/TotalSegmentator
ULS23 https://uls23.grand-challenge.org/
VerSe19 https://osf.io/nqjyw/
VerSe20 https://osf.io/t98fz/
WORD https://paperswithcode.com/dataset/word

Web Tool of SegVol

https://github.com/BAAI-DCAI/SegVol/assets/60123629/242a1578-e418-463c-9d53-a62eeb154c7d

Internal Validation Performance(Dice Score)

External Validation Performance(Dice Score)

We performed an external validation experiment using a novel annotated dataset from the ULS23 Challenge (750 + 744 + 124 cases about lesions) and the validation dataset from Amos22 (120 cases about organs). SegVol showed strong segmentation abilities compared to other medical SAM methods in accurately segmenting lesions and 15 important organs.

Visualization

Dataset (Released)

Internal Validation

External Validation

News

(2024.01.03) A radar map about zero-shot experiment has been reported.

(2023.12.25) Our web tool supports download results now! You can use it as an online tool.

(2023.12.15) The training code has been uploaded!

(2023.12.04) A web tool of SegVol is here! Just enjoy it!

(2023.11.28) Our model and demo case have been open-source at huggingface/BAAI/SegVol.

(2023.11.28) The usage of pre-trained ViT has been uploaded.

(2023.11.24) You can download weight files of SegVol and ViT(CTs pre-train) from huggingface/BAAI/SegVol or Google Drive.

(2023.11.23) The brief introduction and instruction have been uploaded.

(2023.11.23) The inference demo code has been uploaded.

(2023.11.22) The first edition of our paper has been uploaded to arXiv.

Citation

If you find this repository helpful, please consider citing:

…

Acknowledgement

This work is supported by the National Science and Technology Major Project (No. 2022ZD0116314).

Thanks for the following amazing works:

HuggingFace.

CLIP.

MONAI.

3D Slicer.

Image by brgfx on Freepik.

Image by muammark on Freepik.

Issues· 0 开放

查看全部 Issues在 GitHub 打开

暂无开放 Issues,或尚未同步最近议题。

> 标签

Python

暂无评论,来聊聊你的看法吧

> 工具信息

发布日期2026年8月1日
最后更新2026年9月17日
分类编程语言
定价开源

> 相关工具

T
TypeScript
JavaScript 的超集,为前端与全栈提供静态类型
P
Python
通用编程语言,广泛用于 Web、数据与 AI
G
Go
Google 推出的简洁高效系统语言