百科.dev
全部条目在线工具AI 编程趋势榜开源项目技术资讯提交条目
登录
< 返回工具列表
S

SPARK

> 编程语言
开源

SIGGRAPH Asia 2024论文 SPARK 的官方实现:自监督的个性化实时单眼人脸捕获

399 stars0 点赞1 次浏览
访问官网GitHub

工具介绍

SIGGRAPH Asia 2024论文 SPARK 的官方实现:自监督的个性化实时单眼人脸捕获

SPARK: Self-supervised Personalized Real-time Monocular Face Capture

    Kelian Baert
    ·
    Shrisha Bharadwaj
    ·
    Fabien Castan
    ·
    Benoit Maujean
    ·
    Marc Christie
    ·
    Victoria Fernandez Abrevaya
    ·
    Adnane Boukhayma




    Technicolor | Max Planck Institute | INRIA Rennes
    

    SIGGRAPH Asia 2024 Conference Papers

Citation

If you find our code or paper useful, please cite as:

…

Installation

Details
  • Create the environment using setup.sh.
  • Run TrackerAdaptation/setup_submodules.sh. This may take a few minutes.
  • Link FLAME from MultiFLARE to EMOCA: ln TrackerAdaptation/submodules/EMOCA/assets/FLAME/geometry/generic_model.pkl MultiFLARE/assets/flame/flame2020.pkl
    • This is equivalent to downloading FLAME (2020 version), unzipping it and copying generic_model.pkl at ./MultiFLARE/assets/flame/flame2020.pkl.
  • Get Basel Face Model texture space adapted to FLAME. Unfortunately, we are not allowed to distribute the texture space since the license does not permit it. Therefore, please use the tool from this repo to convert the texture space to FLAME. Put the resulting texture model file at TrackerAdaptation/submodules/EMOCA/assets/FLAME/texture/FLAME_albedo_from_BFM.npz.

SPARK has been tested with NVIDIA RTX A5000 (24GB) or RTX A4000 (16GB) GPUs. It is possible to train on GPUs with less memory by reducing the batch size.

Dataset

Please refer to the MonoFaceCompute repository to preprocess your own data.

Usage

SPARK is a two-stage approach. First, run MultiFLARE to reconstruct a 3D Face Avatar from multiple videos. Then, use TrackerAdaptation to adapt an existing 3D face tracker to your avatar for real-time tracking through transfer learning.

Details

1. MultiFLARE

bash
cd MultiFLARE
python train.py --config configs/example.txt

# Export neutral mesh
python export_mesh.py --config configs/example.txt --resume 3000 --out_dir /tmp/example_mesh --tex_type albedo

We advise starting from the provided example config and modifying input_dir, train_dir and output_dir. For a list of all parameters, please refer to arguments.py or the output of python train.py --help. Parameters can be passed either in the config file or as command line arguments.

2. TrackerAdaptation

…

License Information

The code in this repository is subject to multiple licenses.

  1. Original Code (Technicolor Group & INRIA Rennes)

    • All code in this repository, except where otherwise specified, is licensed under the CC BY-NC-SA License.
  2. Third-Party Code (Max Planck Institute for Intelligent Systems)

    • Location: ./MultiFLARE/flame, ./MultiFLARE/flare, ./TrackerAdaptation/submodules
    • These directories contain code by Max Planck Institute, with some modifications. Please carefully read the MPI License and note that this is only available for non-commercial scientific research purposes.

Issues· 3 开放

查看全部 Issues在 GitHub 打开

暂无开放 Issues,或尚未同步最近议题。

> 标签

Python

暂无评论,来聊聊你的看法吧

> 工具信息

发布日期2026年8月1日
最后更新2026年9月17日
分类编程语言
定价开源

> 相关工具

T
TypeScript
JavaScript 的超集,为前端与全栈提供静态类型
P
Python
通用编程语言,广泛用于 Web、数据与 AI
G
Go
Google 推出的简洁高效系统语言