️ ComfyUI 实现了用于视频补画的 ProPainter 框架。
ComfyUI implementation of ProPainter for video inpainting. ProPainter is a framework that utilizes flow-based propagation and spatiotemporal transformer to enable advanced video frame editing for seamless inpainting tasks.
You can use ComfyUI Manager to install the nodes:
ComfyUI ProPainter Nodes and author daniabib.Clone this repository to ComfyUI/custom_nodes:
git clone https://github.com/daniabib/ComfyUI_ProPainter_Nodes
Install the required dependencies:
pip install -r requirements.txt
Models will be automatically downloaded to the weights folder.
Basic Inpainting Workflow
** Section under construction**
image: The video frames to be inpainted.mask: The mask indicating the regions to be inpainted. Mask must have same size of video frames.width: Width of the output images. (default: 640).height: Height of the output images. (default: 360).mask_dilates: Dilation size for the mask (default: 5).flow_mask_dilates: Dilation size for the flow mask (default: 8).ref_stride: Stride for reference frames (default: 10).neighbor_length: Length of the neighborhood for inpainting (default: 10).subvideo_length: Length of subvideos for processing (default: 80).raft_iter): Number of iterations for RAFT model (default: 20).fp16: Enable or disable FP16 precision (default: "enable").IMAGE: The inpainted video frames.FLOW_MASK: The flow mask used during inpainting.MASK_DILATE: The dilated mask used during inpainting.Note: The authors of the paper didn't mention the outpainting task for their framework, but there is an option for it in the original code. The results aren't very good but I decided to implement a node for it anyway.
image: The video frames to be outpainted.width: Width of the video frames (default: 640).height: Height of the video frames (default: 360).width_scale: Scale factor for width expansion (default: 1.2).height_scale: Scale factor for height expansion (default: 1.0).mask_dilates: Dilation size for the mask (default: 5).flow_mask_dilates: Dilation size for the flow mask (default: 8).ref_stride: Stride for reference frames (default: 10).neighbor_length: Length of the neighborhood for outpainting (default: 10).subvideo_length: Length of subvideos for processing (default: 80).raft_iter: Number of iterations for RAFT model (default: 20).fp16: Enable or disable FP16 precision (default: "disable").IMAGE: The outpainted video frames.OUTPAINT_MASK: The mask used during outpainting.output_width: The width of the outpainted frames.output_height: The height of the outpainted frames.The ProPainter models and code are licensed under NTU S-Lab License 1.0.
暂无开放 Issues，或尚未同步最近议题。