百科.dev
全部条目在线工具AI 编程趋势榜开源项目技术资讯提交条目
登录
< 返回工具列表
C

Change-Agent

> 编程语言
开源

[IEEE TGRS 2024] 变化代理: 朝着交互式全面遥感变化解释和分析的发展

199 stars0 点赞0 次浏览
访问官网GitHub

工具介绍

[IEEE TGRS 2024] 变化代理: 朝着交互式全面遥感变化解释和分析的发展

Share us a :star: if you're interested in this repo

Official PyTorch implementation of the paper: "Change-Agent: Toward Interactive Comprehensive Remote Sensing Change Interpretation and Analysis" in [IEEE] (Accepted by IEEE TGRS 2024)

News

  • 2024-06: The code is available.
  • 2024-03: The paper is available.
  • Our survey "Remote Sensing Temporal Vision-Language Models: A Comprehensive Survey": Arxiv || Github

Table of Contents

  • LEVIR-MCI dataset
  • Training of MCI model
  • Construction of Change-Agent
  • Citation

LEVIR-MCI dataset

  • Download the LEVIR_MCI dataset: LEVIR-MCI (Available Now!).
  • This dataset is an extension of our previously established LEVIR-CC dataset. It contains bi-temporal images as well as diverse change detection masks and descriptive sentences. It provides a crucial data foundation for exploring multi-task learning for change detection and change captioning.

Training of the multi-level change interpretation model

The overview of the MCI model:

Preparation

  • Environment Installation:

    Step 1: Create a virtual environment named Multi_change_env and activate it.

    python
    conda create -n Multi_change_env python=3.9
    conda activate Multi_change_env

    Step 2: Download or clone the repository.

    python
    git clone https://github.com/Chen-Yang-Liu/Change-Agent.git
    cd ./Change-Agent/Multi_change

    Step 3: Install dependencies.

    python
    pip install -r requirements.txt
  • Download Dataset:

    Link: LEVIR-MCI. The data structure of LEVIR-MCI is organized as follows:

    ├─/DATA_PATH_ROOT/Levir-MCI-dataset/
            ├─LevirCCcaptions.json
            ├─images
                 ├─train
                 │  ├─A
                 │  ├─B
                 │  ├─label
                 ├─val
                 │  ├─A
                 │  ├─B
                 │  ├─label
                 ├─test
                 │  ├─A
                 │  ├─B
                 │  ├─label

    where folder A contains pre-phase images, folder B contains post-phase images, and folder label contains the change detection masks.

  • Extract text files for the descriptions of each image pair in LEVIR-MCI:

    bash
    python preprocess_data.py

    After that, you can find some generated files in ./data/LEVIR_MCI/.

Train

Make sure you performed the data preparation above. Then, start training as follows:

python
python train.py --train_goal 2 --data_folder /DATA_PATH_ROOT/Levir-MCI-dataset/images --savepath ./models_ckpt/

Evaluate

python
python test.py --data_folder /DATA_PATH_ROOT/Levir-MCI-dataset/images --checkpoint {checkpoint_PATH}

We recommend training the model 5 times to get an average score.

Inference

Run inference to get started as follows:

python
python predict.py --imgA_path {imgA_path} --imgB_path {imgA_path} --mask_save_path ./CDmask.png

You can modify --checkpoint of Change_Perception.define_args() in predict.py. Then you can use your own model, of course, you also can download our pretrained model MCI_model.pth here: [Hugging face]. After that, put it in ./models_ckpt/.

Construction of Change-Agent

  • Agent Installation:

    python
    cd ./Change-Agent/lagent-main
    pip install -e .[all]
  • Run Agent:

    cd into the Multi_change folder:

    python
    cd ./Change-Agent/Multi_change

    (1) Run Agent Cli Demo:

    bash
    # You need to install streamlit first
    # pip install streamlit
    python try_chat.py

    (2) Run Agent Web Demo:

    bash
    # You need to install streamlit first
    # pip install streamlit
    streamlit run react_web_demo.py

Citation

If you find this paper useful in your research, please consider citing:

…

Acknowledgement

Thanks to the following repository:

RSICCformer; Chg2Cap; lagent

License

This repo is distributed under MIT License. The code can be used for academic purposes only.

Contact Us

If you have any other questions❓, please contact us in time

Issues· 11 开放

查看全部 Issues在 GitHub 打开

暂无开放 Issues,或尚未同步最近议题。

> 标签

Python

暂无评论,来聊聊你的看法吧

> 工具信息

发布日期2026年8月1日
最后更新2026年9月18日
分类编程语言
定价开源

> 相关工具

T
TypeScript
JavaScript 的超集,为前端与全栈提供静态类型
P
Python
通用编程语言,广泛用于 Web、数据与 AI
G
Go
Google 推出的简洁高效系统语言