百科.dev
全部条目在线工具AI 编程趋势榜开源项目技术资讯提交条目
登录
< 返回工具列表
V

VisionLLaMA

> 编程语言
开源

VisionLLaMA: 一个用于视觉任务的统一 LLaMA 后端

392 stars0 点赞1 次浏览
访问官网GitHub

工具介绍

VisionLLaMA: 一个用于视觉任务的统一 LLaMA 后端

[ECCV2024] VisionLLaMA: A Unified LLaMA Backbone for Vision Tasks

Introduction

Large language models are built on top of a transformer-based architecture to process textual inputs. For example, the LLaMA stands out among many open-source implementations. Can the same transformer be used to process 2D images? In this paper, we answer this question by unveiling a LLaMA-like vision transformer in plain and pyramid forms, termed VisionLLaMA, which is tailored for this purpose. VisionLLaMA is a unified and generic modelling framework for solving most vision tasks. We extensively evaluate its effectiveness using typical pre-training paradigms in a good portion of downstream tasks of image perception and especially image generation. In many cases, VisionLLaMA have exhibited substantial gains over the previous state-of-the-art vision transformers. We believe that VisionLLaMA can serve as a strong new baseline model for vision generation and understanding.

Generation

DITLLaMA

Please refer to DiTLLaMA.md

SITLLaMA

Please refer to SiTLLaMA.md

UnderStanding

Pretrain using MIM

The pre-training instruction is in PRETRAIN.md.

ImageNet 1k Supervised Training

Please refer to ImageNet1k_SFT

ADE 20k Segmentation

Please refer to Segmentation.md.

COCO Detection

Please refer to Detection.md.

✏️ Reference

If you find VisionLLaMA useful in your research or applications, please consider giving a star ⭐ and citing using the following BibTeX:

@inproceedings{chu2024visionllama,
  title={VisionLLaMA: A Unified LLaMA Backbone for Vision Tasks},
  author={Chu, Xiangxiang and Su, Jianlin and Zhang, Bo and Shen, Chunhua},
  booktitle={European Conference on Computer Vision},
  year={2024}
}

Issues· 0 开放

查看全部 Issues在 GitHub 打开

暂无开放 Issues,或尚未同步最近议题。

> 标签

Python

暂无评论,来聊聊你的看法吧

> 工具信息

发布日期2026年8月1日
最后更新2026年9月17日
分类编程语言
定价开源

> 相关工具

T
TypeScript
JavaScript 的超集,为前端与全栈提供静态类型
P
Python
通用编程语言,广泛用于 Web、数据与 AI
G
Go
Google 推出的简洁高效系统语言