Lucy-Edit-ComfyUI

Lucy Edit - ComfyUI

GitHub  |  Huggingface  |  Playground  |  Technical Report  |  Discord

Lucy Edit is a video editing model that performs instruction-guided edits on videos using free-text prompts — it supports a variety of edits, such as clothing & accessory changes, character changes, object insertions, and scene replacements while preserving the motion and composition perfectly.

• ‍♂️ Motion Preservation - preserves the motion and composition of videos perfectly, allowing precise edits.
• Edit reliability — edits are more robust when compared to common inference time methods.
• Wardrobe & accessories — change outfits, add glasses/earrings/hats/etc.
• Character Changes — replace characters with monsters, animals and known characters. (e.g., "Replace the person with a polar bear")
• ️ Scenery swap — move the scene (e.g., "transform the scene into a 2D cartoon,")
• Pure text instructions — no finetuning, no masks required for common edits

️ Quickstart

Installation

1. Clone this repo into custom_nodes folder.
2. Install dependencies: pip install -r requirements.txt

Download Model Weights

1. Download the appropriate weights for your setup:

   • FP16 weights:
     https://huggingface.co/decart-ai/Lucy-Edit-Dev-ComfyUI/resolve/main/lucy-edit-1.1-dev-cui-fp16.safetensors

   • FP32 weights:
     https://huggingface.co/decart-ai/Lucy-Edit-Dev-ComfyUI/resolve/main/lucy-edit-1.1-dev-cui.safetensors

2. Place the weights under: models/diffusion_models/

Usage

Please refer to the "Prompting Guidelines & Supported Edits" section for the best experience.

Lucy Edit Pro (API)

1. Load the workflow from examples/basic-api-lucy-edit.json.
2. Get an api key from: https://platform.decart.ai/.

Lucy Edit Dev (Local)

1. Load the workflow from examples/basic-lucy-edit-dev.json

Demos

Note: The prompts above are not enriched, the model will react better to enriched prompts - as described in the prompt guideline section below.

Roadmap

• ✅ API based custom nodes.
• ✅ local inference custom nodes.
• Add support for Lucy Edit Dev/Image API

Latest News

• [2025-11-07]: Lucy Edit 1.1 Dev Weights released on huggingface and ComfyUI.
• [2025-09-17]: Initial Lucy Edit Dev weights & reference code released.
• [2025-09-16]: Diffusers integration PR Merged. PR #12340.
• [2025-09-16]: Diffusers integration PR opened. PR #12340.

Prompting Guidelines & Supported Edits

Lucy Edit is built for precise, realistic, and identity-preserving video edits.
Prompts with ~20–30 descriptive words work best. Using the right trigger words helps the model understand your intent.

Trigger Words

• Change → Clothing or color modifications
• Add → Adding animals or objects
• Replace → Object substitution or subject swap
• Transform to → Global scene or style transformations

Supported Edit Types

1. Clothing Changes

✅ Best performance. Lucy Edit excels at swapping outfits while preserving motion, pose, and identity.
Example: “Change the shirt to a kimono with wide sleeves and patterned fabric.”

2. Human/Character Replacement

✅ Strong results. Works well for transforming people into new characters or creatures. Detailed prompts are key.
Example: “Replace the person with a tiger, striped orange fur, muscular build, and glowing green eyes.”
Example: “Replace the person with an 2D anime character, big eyes, blue gown and battle scars.”

3. Replace Objects

✅ Reliable for structure-preserving swaps. Ideal when replacing one object with another of similar scale.
Example: “Replace the apple with a glowing crystal ball emitting blue light.”

4. Color Changes

⚠️ Mixed reliability. Sometimes subtle, sometimes exaggerated. Works best with precise descriptions.
Example: “Change the jacket color to deep red leather with a glossy finish.”

5. Add Objects

⚠️ Often attaches to the subject. Works best for wearable or handheld props.
Example: “Add a golden crown on the person’s head, decorated with ornate jewels.”

6. Global Transformations

⚠️ Effective for backgrounds or scene-wide changes, might alter the subject Alter environment or style, might, Often changes the identity of the subject. Example: “Transform the sunny beach into a snowy tundra with falling snowflakes.”

Additional Notes

• Strengths: Lucy Edit excels at identity conservation, edit precision, realism, and prompt adherence.
• Detail matters: Longer prompts (20–30 words) describing style, appearance, and context improve results.
• Frame count: 81-frame generations produce better temporal consistency than shorter clips.

If you want to use an LLM for prompt enhancement, below is a good system-prompt example:

…

Contact

• GitHub Issues: DecartAI/lucy-edit.
• Discord: Join our discord server, here.