Baike.dev
All toolsOnline toolsAI codingTrendingOpen sourceNewsSubmit
Log in
< Back to tools
S

SPARK

> 编程语言
Open source

Official implementation for the SIGGRAPH Asia 2024 paper SPARK: Self-supervised Personalized Real-time Monocular Face Capture

399 stars0 likes1 views
WebsiteGitHub

About

Official implementation for the SIGGRAPH Asia 2024 paper SPARK: Self-supervised Personalized Real-time Monocular Face Capture

SPARK: Self-supervised Personalized Real-time Monocular Face Capture

    Kelian Baert
    ·
    Shrisha Bharadwaj
    ·
    Fabien Castan
    ·
    Benoit Maujean
    ·
    Marc Christie
    ·
    Victoria Fernandez Abrevaya
    ·
    Adnane Boukhayma




    Technicolor | Max Planck Institute | INRIA Rennes
    

    SIGGRAPH Asia 2024 Conference Papers

Citation

If you find our code or paper useful, please cite as:

…

Installation

Details
  • Create the environment using setup.sh.
  • Run TrackerAdaptation/setup_submodules.sh. This may take a few minutes.
  • Link FLAME from MultiFLARE to EMOCA: ln TrackerAdaptation/submodules/EMOCA/assets/FLAME/geometry/generic_model.pkl MultiFLARE/assets/flame/flame2020.pkl
    • This is equivalent to downloading FLAME (2020 version), unzipping it and copying generic_model.pkl at ./MultiFLARE/assets/flame/flame2020.pkl.
  • Get Basel Face Model texture space adapted to FLAME. Unfortunately, we are not allowed to distribute the texture space since the license does not permit it. Therefore, please use the tool from this repo to convert the texture space to FLAME. Put the resulting texture model file at TrackerAdaptation/submodules/EMOCA/assets/FLAME/texture/FLAME_albedo_from_BFM.npz.

SPARK has been tested with NVIDIA RTX A5000 (24GB) or RTX A4000 (16GB) GPUs. It is possible to train on GPUs with less memory by reducing the batch size.

Dataset

Please refer to the MonoFaceCompute repository to preprocess your own data.

Usage

SPARK is a two-stage approach. First, run MultiFLARE to reconstruct a 3D Face Avatar from multiple videos. Then, use TrackerAdaptation to adapt an existing 3D face tracker to your avatar for real-time tracking through transfer learning.

Details

1. MultiFLARE

bash
cd MultiFLARE
python train.py --config configs/example.txt

# Export neutral mesh
python export_mesh.py --config configs/example.txt --resume 3000 --out_dir /tmp/example_mesh --tex_type albedo

We advise starting from the provided example config and modifying input_dir, train_dir and output_dir. For a list of all parameters, please refer to arguments.py or the output of python train.py --help. Parameters can be passed either in the config file or as command line arguments.

2. TrackerAdaptation

…

License Information

The code in this repository is subject to multiple licenses.

  1. Original Code (Technicolor Group & INRIA Rennes)

    • All code in this repository, except where otherwise specified, is licensed under the CC BY-NC-SA License.
  2. Third-Party Code (Max Planck Institute for Intelligent Systems)

    • Location: ./MultiFLARE/flame, ./MultiFLARE/flare, ./TrackerAdaptation/submodules
    • These directories contain code by Max Planck Institute, with some modifications. Please carefully read the MPI License and note that this is only available for non-commercial scientific research purposes.

Issues· 3 open

View all issuesOpen on GitHub

No open issues yet, or sync has not completed.

> Tags

Python

No comments yet. Be the first to share.

> Details

PublishedAug 1, 2026
UpdatedSep 17, 2026
Category编程语言
PricingOpen source

> Related tools

T
TypeScript
JavaScript 的超集,为前端与全栈提供静态类型
P
Python
通用编程语言,广泛用于 Web、数据与 AI
G
Go
Google 推出的简洁高效系统语言