[AI Illustration] Introduction of Recommended Custom Nodes for ComfyUI

In this article, we will show you how to install custom nodes in ComfyUI and some recommended custom nodes. A custom node is an extension in A1111 WebUI. By using custom nodes, you can extend the functionality of ComfyUI. We will also cover powerful custom nodes such as “ComfyUI Impact Pack” and “ComfyUI-AnimateDiff-Evolved”, so please read to the end.

ComfyUI Manager

The first thing to install when introducing custom nodes is the ComfyUI Manager, which will make it easier to manage custom nodes.

How to install ComfyUI Manager

• If ConfyUI is running, please terminate it.
• Open ComfyUI/custom_nodes in File Explorer.
• Right-click and select “Open in Terminal” and confirm that you are in the directory custom_nodes . If you cannot right-click and select “Open in Terminal,” launch a command prompt and navigate to the custom_nodes directory.
• Clone the “ComfyUI Manager” repository with the Git command.

  　Open Image

  git clone https://github.com/ltdrdata/ComfyUI-Manager.git

  📋
• Start ConfyUI.
• If you see “Manager” at the bottom of the main menu, the installation was successful.

ComfyUI Manager main features list

• Detection of missing nodes: Automatic detection of missing custom nodes and installation support
• Custom Node Management: Control installation, uninstallation, update, enablement, and disablement of custom nodes
• WebUI Extension Alternatives: Proposed alternate node for A1111 WebUI extensions
• ComfyUI Update: ComfyUI can be updated from the Manager menu
• Model Download: Models can be downloaded from a list in the Manager menu.
• Show runtime preview: From the Manager menu, change the Preview method to display the runtime preview in KSampler

Enhancement-related custom nodes

ComfyUI Impact Pack

“ComfyUI Impact Pack” adds features such as object detection in images, refinement of image details, image upscaling, etc. Similar to A1111 WebUI’s ADetailer, it can be incorporated.

How to install ComfyUI Impact Pack

• Open “Custom Nodes Manager” from ComfyUI Manager.
• Enter ComfyUI Impact Pack in the search field in the upper left corner.

  ComfyUI Impact Pack

  📋

  　Open Image

• Click the “Install” button next to “ComfyUI Impact Pack” in the list to install.
• When installation is complete, a message for restarting ConfyUI will be displayed.

ComfyUI Impact Pack main features list

• Detector nodes: Detects faces, hands, etc. from images
• ControlNet, IPAdapter: Collection of nodes for using SEGS data with ControlNet and IPAdapter
• Mask operation: Control masks using SEGS data
• Detailer nodes: Use SEGS data to add detail
• SEGS Manipulation nodes: Collection of nodes for manipulating SEGS data
• Pipe nodes: Collection of pipeline-related nodes that bring together multiple wires, such as DETAILER_PIPE and BASIC_PIPE
• PK_HOOK (Pixel KSample Hook): Dynamic control of CFG and other values during generation
• DETAILER_HOOK: Dynamic control of the detailing process during generation
• Iterative Upscale nodes: Interactively adjust upscale
• TwoSamplers nodes: Generated using two samplers: base and mask
• Image Utils: Collection of image-related nodes
• Switch nodes: Collection of nodes that switch multiple inputs
• Wildcards nodes: Collection of nodes using wildcards
• Regional Sampling: Collection of nodes used to create regions in the generated image to generate multiple characters
• Impact KSampler: Collection of nodes using the pipe version sampler
• Batch/List Util: Manage images generated in multiple batches

Example of using ComfyUI Impact Pack

A workflow with explanations using upscaling, facial restoration, and pipes is available on DCAI’s Patreon for those interested in downloading it.

ComfyUI IPAdapter plus

“ComfyUI IPAdapter plus” is a tool used to create a consistent style and composition between different images, or to generate videos, cartoons, etc. using the same characters. It makes it easier to maintain a cohesive visual theme in your work.

How to install ComfyUI IPAdapter plus

Only one of them can be installed because they conflict with the custom node “ComfyUI-Kolors-MZ”. Fixed on 2024/7/18 to prevent conflicts.

• Open “Custom Nodes Manager” from ComfyUI Manager.
• Enter ComfyUI_IPAdapter_plus in the upper left search field.

  ComfyUI_IPAdapter_plus

  📋
• Click the “Install” button next to “ComfyUI_IPAdapter_plus” in the list to install.
• When installation is complete, a message for restarting ConfyUI will be displayed.
• Place the following model in /ComfyUI/models/clip_vision.
  • Download 🔗CLIP-ViT-H-14-laion2B-s32B-b79K.safetensors and change the name model to CLIP-ViT-H-14-laion2B-s32B-b79K.
  • Download 🔗CLIP-ViT-bigG-14-laion2B-39B-b160k.safetensors and change the name model to CLIP-ViT-bigG-14-laion2B-39B-b160k.
  • Download 🔗clip-vit-large-patch14-336.bin and change the name model to clip-vit-large-patch14-336.(For Kolors only)
• Place the following model in /ComfyUI/models/ipadapter.
  • 🔗ip-adapter_sd15.safetensors Basic Model Average Weight
  • 🔗ip-adapter_sd15_light_v11.binLightweight model
  • 🔗ip-adapter-plus_sd15.safetensors Plus model Very strong weights
  • 🔗ip-adapter-plus-face_sd15.safetensors Facial models Suitable for portraits
  • 🔗ip-adapter-full-face_sd15.safetensors Face model Strong weights
  • 🔗ip-adapter_sd15_vit-G.safetensors vit-G model bigG clip vision encoder required
  • 🔗ip-adapter_sdxl.safetensors Basic model for SDXL
  • 🔗ip-adapter-plus_sdxl_vit-h.safetensors Plus model for SDXL
  • 🔗ip-adapter-plus-face_sdxl_vit-h.safetensors Face model for SDXL
  • 🔗ip-adapter_sdxl.safetensors vit-G model for SDXL bigG clip vision encoder required
• If you use FaceID, place the following model in /ComfyUI/models/ipadapter.
  • 🔗ip-adapter-faceid_sd15 Basic model for FaceID
  • 🔗ip-adapter-faceid-plusv2_sd15.bin Plus Model V2 for FaceID
  • 🔗 Style transfer of text prompts for portrait for FaceID
  • 🔗ip-adapter-faceid_sdxl.bin SDXL Basic Model for FaceID
  • 🔗ip-adapter-faceid-plusv2_sdxl SDXL Plus Model V2 for FaceID
  • 🔗ip-adapter-faceid-portrait_sdxl.bin Style transfer of text prompts for SDXL portrait for FaceID
  • 🔗ip-adapter-faceid-portrait_sdxl_unnorm.bin Style transfer of text prompts for SDXL portrait for FaceID Very strong weights

*The Pyhon library insightface is required to use the FaceID model. Install the version appropriate for your environment using the -m pip install command. If it is already installed and an error occurs, reinstall it. Please note that insightface is a non-commercial license.

• Python Version Checking: Open the root folder of ComfyUI Portabl (e.g. Users\username\ComfyUI_windows_portable) in a terminal. Execute the following command

  python_embeded\python.exe -V

  📋
• Download Library: Download the appropriate library for your version of Pyhon. 🔗For pyhon 3.10 🔗For pyhon 3.11
• Update pip: Update pip with the following command.

  python_embeded\python.exe -m pip install -U pip

  📋
• Installing insightface: Install the appropriate library for your version of Pyhon.

  pyhon 3.10:
  python_embeded\python.exe -m pip install insightface-0.7.3-cp310-cp310-win_amd64.whl
  pyhon 3.11:
  python_embeded\python.exe -m pip install insightface-0.7.3-cp311-cp311-win_amd64.whl

  📋

ComfyUI IPAdapter plus main features list

• character reference: Generate image with characters from reference image
• Style transfer: Generate images using the style of the reference image
• Composition reference: Generate images using the screen configuration of the reference image
• Advanced Batch Processing: Set batch sizes, especially when creating videos, to reduce VRAM consumption
• Region Adjustment: Specific areas can be masked and controlled
• Schedule Weights: Schedule weights during video generation for smooth transitions

Example of using ComfyUI IPAdapter plus

A simple workflow for style references is available on DCAI’s Patreon for those interested in downloading it. Reference images are also available.

Utility-related custom nodes

ComfyUI-Custom-Scripts

”ComfyUI-Custom-Scripts” packs a variety of useful functions such as autocomplete, graph snapping, custom node colors, viewing detailed model information, and sound alerts.

How to install ComfyUI-Custom-Scripts

• Open “Custom Nodes Manager” from ComfyUI Manager.
• Type ComfyUI-Custom-Scripts in the search field in the upper left corner.

  ComfyUI-Custom-Scripts

  📋
• Click the “Install” button next to “Crystools” in the list to install.
• When installation is complete, a message for restarting ConfyUI will be displayed.

ComfyUI-Custom-Scripts main features list

• Autocomplete：Autocomplete function. It assists with prompt entry.
• Auto Arrange Graph：Graph auto-alignment. It aligns the layout of nodes with one click.
• Always Snap to Grid：Snap Function. It snaps the nodes to the grid of the canvas.
• Checkpoint/LoRA/Embedding Info：Right-click on a node in the model to view its info.
• Custom Colors：You can freely change the color of the nodes.
• Favicon Status：You can check the status of ComfyUI with the favicon.
• Image Feed：The generated images can be viewed at a glance. You can also drag and drop images to load workflows.
• Play Sound：It notifies you with a sound at the timing of node execution.
• System Notification：The browser will notify you when the node is about to be executed.
• Show Text：You can browse the TEXT of the nodes you have connected.
• String Function：Used to connect or replace multiple strings.
• Widget Defaults：You can edit the default value of a node.

ComfyUI-Crystools

“ComfyUI-Crystools” is a tool that allows you to comfortably use ComfyUI by displaying resource monitors, etc. on ConfyUI.

How to install ComfyUI-Crystools

• Open “Custom Nodes Manager” from ComfyUI Manager.
• Type Crystools in the search field in the upper left corner.

  Crystools

  📋
• Click the “Install” button next to “Crystools” in the list to install.
• When installation is complete, a message for restarting ConfyUI will be displayed.

ComfyUI-Crystools main features list

• Resource Monitor: Displays CPU/GPU/RAM/VRAM utilization and GPU temperature/disk space
• ProgressBar: Progress bar on main menu to show graph progress
• Metadata: Extract and compare metadata from generated images
• Debugger: Extract and display metadata, prompts, and other data necessary for debugging
• Images: Extract and display data related to the image
• Pipe: Various wires are brought together and connected by a single wire.
• Primitive: Primitive Node Collection
• Switch: Nodes can be conditionally switched

Image Chooser

“Image Chooser” is a simple but powerful node. It allows you to select only the best images from a batch of generated images and pass them on to the next process. An example of its use would be to generate several low-resolution roughs and send only the best of them to Hires. Fix.

How to install Image Chooser

• Open “Custom Nodes Manager” from ComfyUI Manager.
• TypeImage chooserin the search field in the upper left corner.

  Image chooser

  📋
• Click the “Install” button next to “Image chooser” in the list to install.
• When installation is complete, a message for restarting ConfyUI will be displayed.

Image Chooser main features list

• Preview and Select: Only selected images from the generated images specified by batch size are advanced to the next process
• Mode Selection: Execution method can be changed by mode
• Hot Keys: Selected by 1-9 and proceed to the next process for the image selected by 0
• Alerts: A sound notification can be made when the image chooser node is in standby mode
• Support for Fabric custom nodes: Select positive/negative images for Fabric node *Already no longer supported but can be used

About Modes

• Alwayse pause: Default. Wait for image to be selected.
• Repeat last selection: If there is no change in the graph, the same image as the previous one is sent next. If there are any changes, it waits for the user to select an image.
• Only pause if batch: If the batch is 1, it is sent directly to the next batch; if the batch is 2 or more, it waits for an image to be selected.
• Progress first pick: Select the first one at any time and send the next one.
• Pass through: Send all images to the next
• Take First n: Send the first n images up to the next (n is specified by count)
• Take Last n: Send the nth image from the last to the next

Example of using Image Chooser

A simple workflow for Preview Chooser is available on DCAI’s Patreon for those interested in downloading it.

Use Everywhere (UE Nodes)

“Use Everywhere (UE Nodes)” is a tool that skips input values without drawing canvas wires and prevents the canvas from becoming cluttered with wires. If you lose track of the connections, you can also view them from the right-click menu.

How to install Use Everywhere (UE Nodes)

• Open “Custom Nodes Manager” from ComfyUI Manager.
• TypeUse Everywhere (UE Nodes)in the search field in the upper left corner.

  Use Everywhere (UE Nodes)

  📋
• Click the “Install” button next to “Use Everywhere (UE Nodes)” in the list to install.
• When installation is complete, a message for restarting ConfyUI will be displayed.

Use Everywhere (UE Nodes) main features list

• Anything Everywhere: Connects input data to where it is needed without wires
• Anything Everywhere3: Connects the three inputted data to the required locations without wires
• Anything Everywhere?: Connects input data to specified locations without wires
• Seed Everywhere: Connect the set seed to the required location without wires
• Prompts Everywhere: Connect the set prompts to the required locations without wires

Example of using Use Everywhere (UE Nodes)

Sample workflows of example usage patterns for Use Everywhere are available on DCAI’s Patreon for those interested in downloading them.

rgthree's ComfyUI Nodes

“rgthree’s ComfyUI Nodes” is a tool to make ComfyUI easier to use.

How to install rgthree’s ComfyUI Nodes

• Open “Custom Nodes Manager” from ComfyUI Manager.
• Typergthree's ComfyUI Nodesin the search field in the upper left corner.

  rgthree's ComfyUI Nodes

  📋
• Install from the “Install” button next to “rgthree’s ComfyUI Nodes” displayed in the list.
• When installation is complete, a message for restarting ConfyUI will be displayed.

rgthree’s ComfyUI Nodes main features list

• Progress Bar: A progress bar at the top of the canvas to show the progress of the graph (can be hidden from the settings).
• Seed Node: Can use the same format of Seed as A1111 WebUI
• Reroute Node: More advanced configuration than standard Reroute (see “Node Help” in the Node menu)
• Bookmark Node: Memorize the screen position by placing it at the upper left corner of the desired position on the canvas
• Context / Context Big Nodes: Advanced control over standard workflow
• Image Comparer Node: Compare two images connected to an input
• Power Lora Loader: Easy management of LoRA
• Power Prompt: More advanced settings than the standard CLIP Text Encode (Prompt) (LoRA and Embedding can be applied from a drop-down list)

AI Video-related custom nodes

ComfyUI-VideoHelperSuite

This custom node is essential if you want to generate videos with ComfyUI. Nodes necessary for creating videos from multiple images, loading videos, etc. are available.

How to install ComfyUI-VideoHelperSuite

• Open “Custom Nodes Manager” from ComfyUI Manager.
• TypeComfyUI-VideoHelperSuitein the search field in the upper left corner.

  ComfyUI-VideoHelperSuite

  📋
• Click the “Install” button next to “ComfyUI-VideoHelperSuite” in the list to install.
• When installation is complete, a message for restarting ConfyUI will be displayed.

ComfyUI-VideoHelperSuite main features list

• Saving Video: Saving of multiple input images and videos
• Loading video: Load video files as image sequences
• Loading Image Sequence: Load the specified folder as an image sequence
• Video Integration: Output video from image sequence
• Loading Audio: Load audio by specifying a start time
• Latent image/pixel image node: Nodes for managing latent images and imagery
• Video Preview: Video preview is available
• Advanced Preview: Detailed preview available

ComfyUI-AnimateDiff-Evolved

“ComfyUI-AnimateDiff-Evolved” is a forked version of ArtVentureX / comfyui-animatediff. It is a powerful node pack for generating AI videos.

How to install ComfyUI-AnimateDiff-Evolved

• Open “Custom Nodes Manager” from ComfyUI Manager.
• TypeAnimateDiff-Evolvedin the search field in the upper left corner.

  AnimateDiff-Evolved

  📋
• Click the “Install” button next to “AnimateDiff-Evolved” in the list to install.
• When installation is complete, a message for restarting ConfyUI will be displayed.
• After installation, copy the following motion models to ComfyUI/custom_nodes/ComfyUI-AnimateDiff-Evolved/models . Example mm_sd_v15_v2.ckpt, v3_sd15_mm.ckpt, etc.

ComfyUI-AnimateDiff-Evolved main features list

• Compatible with all Ksampler: Compatible with all standard and custom Ksampler
• Support for Control Net, SparseCtrl, IPAdaptor: Generate high quality video using Control Net, SparseCtrl, and IPAdaptor
• Unlimited animation length: Sliding context sampling to eliminate AnimateDiff model’s 16-frame limit or HotshotXL’s 8-frame limit and set unlimited video duration across Unet.
• Scheduling context option: Adapt different parameters at specified points during sampling
• Advanced sampling options: FreeInit and FreeNoise for more advanced sampling
• Support for Motion LoRA: Support for 🔗official motion LoRA and civitai’s 🔗motion LoRA published by the original AnimateDiff
• Prompt Travel: 🔗FizzNodes can be introduced for t2v prompt travel using BatchPromptSchedule
• Adjust effects with multival input: Adjusted motion weights and impacts
• Custom noise scheduling: Customizable noise schedule with noise types, layers, etc.
• Support for AnimateDiff models: Support for AnimateDiff models V1/V2/V3
• Adaptation of multiple motion models: Gen2 node allows adaptation of multiple motion models
• Support for various motion modules: Support for 🔗HotshotXL 🔗AnimateDiff-SDXL 🔗AnimateLCM 🔗AnimateLCM-I2V 🔗CameraCtrl 🔗PIA
• AnimateDiff keyframe: Adjust weights and motion parameters with keyframes
• Support for fp8: Use of fp8 requires the latest ComfyUI and torch 2.1 or higher

Example of using ComfyUI-AnimateDiff-Evolved

A basic text2mov sample workflow is available on DCAI’s Patreon for those interested in downloading it.

The three sample workflows introduced here are connected to each other. If you have no time to look at them in order, please refer to the “ComfyUI Frame Interpolation (ComfyUI VFI)” sample workflow. All explanations are included.

To use the workflow, you will need the ComfyUI-VideoHelperSuite introduced earlier.

ComfyUI-Advanced-ControlNet

“ComfyUI-Advanced-ControlNet” is a custom node that adapts the standard ControlNet to animation.

How to install ComfyUI-Advanced-ControlNet

• Open “Custom Nodes Manager” from ComfyUI Manager.
• TypeComfyUI-Advanced-ControlNetin the search field in the upper left corner.

  ComfyUI-Advanced-ControlNet

  📋
• Click the “Install” button next to “ComfyUI-Advanced-ControlNet” in the list to install.
• When installation is complete, a message for restarting ConfyUI will be displayed.
• Go to the following page to download the necessary pth file and place it in /ComfyUI/models/controlnet.
  

  lllyasviel/ControlNet-v1-1 · Hugging Face

  https://huggingface.co/lllyasviel/ControlNet-v1-1/tree/main

  🔗External Link

ComfyUI-Advanced-ControlNet main features list

• Scheduling time steps and latent space strength: Control net strength adjusted on a time basis
• Attention Masks: Specify a mask for the area you want to draw attention to
• Prompt vs. control net weights: Adjustment of the weight balance between prompts and control nets implemented in A1111 WebUI
• Sliding Context Windows: Sampling method for stable video generation
• Supporting control net type:
  • ControlNets
  • T2IAdapters
  • ControlLoRAs
  • ControlLLLite
  • SparseCtrls
  • SVD-ControlNets

Example of using ComfyUI-Advanced-ControlNet

A sample workflow for text2mov tile upscaling is available on DCAI’s Patreon for those interested in downloading it.

ComfyUI-VideoHelperSuite and ComfyUI-AnimateDiff-Evolved are required to use the workflow.

ComfyUI Frame Interpolation (ComfyUI VFI)

“ComfyUI-Frame-Interpolation” is a custom node that performs frame interpolation for multiple images and videos. When applied to videos with coarse frame layout, it can improve the quality of video generation and shorten the generation time.

How to install ComfyUI Frame Interpolation

• Open “Custom Nodes Manager” from ComfyUI Manager.
• TypeComfyUI Frame Interpolationin the search field in the upper left corner.

  ComfyUI Frame Interpolation

  📋
• Click the “Install” button next to “ComfyUI Frame Interpolation” in the list to install.
• When installation is complete, a message for restarting ConfyUI will be displayed.

ComfyUI Frame Interpolation main features list

• Frame Interpolations: Frame interpolation of multiple input images and video

Example of using ComfyUI Frame Interpolation

A sample workflow for text2mov frame interpolation is available on DCAI’s Patreon for those interested in downloading it.

ComfyUI-VideoHelperSuite, ComfyUI-AnimateDiff-Evolved, and ComfyUI-Advanced-ControlNet introduced earlier are required to use the workflow.

Final results of sample workflow

The colors have been corrected while adding the logo.

Conclusion

Although the number of introductions in this article may be a little smaller than those in the WebUI article, we have focused on custom nodes to cover basic usage. We will explain the detailed usage of each custom node in detail at another time.