[AI Illustration] Introduction of Recommended Custom Nodes for ComfyUI
![[AI Illustration] Introduction of Recommended Custom Nodes for ComfyUI featured Image](/_next/image?url=https%3A%2F%2Fdca.data-hub-center.com%2Fcontent%2Fuploads%2F2024%2F08%2Feye_catch_comfyui-recommended-custom-nodes_en.jpg&w=3840&q=80)
In this article, we will show you how to install custom nodes in ComfyUI and some recommended custom nodes. A custom node is an extension in A1111 WebUI. By using custom nodes, you can extend the functionality of ComfyUI. We will also cover powerful custom nodes such as “ComfyUI Impact Pack” and “ComfyUI-AnimateDiff-Evolved”, so please read to the end.
In June 2024, it was discovered by _roblaughter_ that a custom node called “ComfyUI_LLMVISION” published by AppleBotzz contained malware that stole user data (passwords, credit card information, etc.). (This repository has now been deleted.) As shown in this case, we need to be very careful with extensions such as ConfyUI and WebUI. Only install extensions from reputable developers. Also, remember that there is always this risk when installing third-party programs.
To learn more about this incident, please visit Reddit’s 🔗PSA: If you’ve used the ComfyUI_LLMVISION node from u/AppleBotzz, you’ve been hacked.
ComfyUI Manager
The first thing to install when introducing custom nodes is the ComfyUI Manager, which will make it easier to manage custom nodes.
How to install ComfyUI Manager
- If ConfyUI is running, please terminate it.
- Open
ComfyUI/custom_nodesin File Explorer. - Right-click and select “Open in Terminal” and confirm that you are in the directory
custom_nodes. If you cannot right-click and select “Open in Terminal,” launch a command prompt and navigate to thecustom_nodesdirectory. -
Clone the “ComfyUI Manager” repository with the Git command.
git clone https://github.com/ltdrdata/ComfyUI-Manager.git - Start ConfyUI.
- If you see “Manager” at the bottom of the main menu, the installation was successful.
ComfyUI Manager main features list
- Detection of missing nodes: Automatic detection of missing custom nodes and installation support
- Custom Node Management: Control installation, uninstallation, update, enablement, and disablement of custom nodes
- WebUI Extension Alternatives: Proposed alternate node for A1111 WebUI extensions
- ComfyUI Update: ComfyUI can be updated from the Manager menu
- Model Download: Models can be downloaded from a list in the Manager menu.
- Show runtime preview: From the Manager menu, change the Preview method to display the runtime preview in KSampler
Enhancement-related custom nodes
ComfyUI Impact Pack
“ComfyUI Impact Pack” adds features such as object detection in images, refinement of image details, image upscaling, etc. Similar to A1111 WebUI’s ADetailer, it can be incorporated.
How to install ComfyUI Impact Pack
- Open “Custom Nodes Manager” from ComfyUI Manager.
-
Enter
ComfyUI Impact Packin the search field in the upper left corner.ComfyUI Impact Pack - Click the “Install” button next to “ComfyUI Impact Pack” in the list to install.
- When installation is complete, a message for restarting ConfyUI will be displayed.
ComfyUI Impact Pack main features list
- Detector nodes: Detects faces, hands, etc. from images
- ControlNet, IPAdapter: Collection of nodes for using SEGS data with ControlNet and IPAdapter
- Mask operation: Control masks using SEGS data
- Detailer nodes: Use SEGS data to add detail
- SEGS Manipulation nodes: Collection of nodes for manipulating SEGS data
- Pipe nodes: Collection of pipeline-related nodes that bring together multiple wires, such as DETAILER_PIPE and BASIC_PIPE
- PK_HOOK (Pixel KSample Hook): Dynamic control of CFG and other values during generation
- DETAILER_HOOK: Dynamic control of the detailing process during generation
- Iterative Upscale nodes: Interactively adjust upscale
- TwoSamplers nodes: Generated using two samplers: base and mask
- Image Utils: Collection of image-related nodes
- Switch nodes: Collection of nodes that switch multiple inputs
- Wildcards nodes: Collection of nodes using wildcards
- Regional Sampling: Collection of nodes used to create regions in the generated image to generate multiple characters
- Impact KSampler: Collection of nodes using the pipe version sampler
- Batch/List Util: Manage images generated in multiple batches
Example of using ComfyUI Impact Pack
A workflow with explanations using upscaling, facial restoration, and pipes is available on DCAI’s Patreon for those interested in downloading it.
ComfyUI IPAdapter plus
“ComfyUI IPAdapter plus” is a tool used to create a consistent style and composition between different images, or to generate videos, cartoons, etc. using the same characters. It makes it easier to maintain a cohesive visual theme in your work.
How to install ComfyUI IPAdapter plus
Only one of them can be installed because they conflict with the custom node “ComfyUI-Kolors-MZ”. Fixed on 2024/7/18 to prevent conflicts.
- Open “Custom Nodes Manager” from ComfyUI Manager.
-
Enter
ComfyUI_IPAdapter_plusin the upper left search field.ComfyUI_IPAdapter_plus - Click the “Install” button next to “ComfyUI_IPAdapter_plus” in the list to install.
- When installation is complete, a message for restarting ConfyUI will be displayed.
-
Place the following model in
/ComfyUI/models/clip_vision.- Download 🔗CLIP-ViT-H-14-laion2B-s32B-b79K.safetensors and change the name model to
CLIP-ViT-H-14-laion2B-s32B-b79K. - Download 🔗CLIP-ViT-bigG-14-laion2B-39B-b160k.safetensors and change the name model to
CLIP-ViT-bigG-14-laion2B-39B-b160k. - Download 🔗clip-vit-large-patch14-336.bin and change the name model to
clip-vit-large-patch14-336.(For Kolors only)
- Download 🔗CLIP-ViT-H-14-laion2B-s32B-b79K.safetensors and change the name model to
-
Place the following model in
/ComfyUI/models/ipadapter.- 🔗ip-adapter_sd15.safetensors Basic Model Average Weight
- 🔗ip-adapter_sd15_light_v11.binLightweight model
- 🔗ip-adapter-plus_sd15.safetensors Plus model Very strong weights
- 🔗ip-adapter-plus-face_sd15.safetensors Facial models Suitable for portraits
- 🔗ip-adapter-full-face_sd15.safetensors Face model Strong weights
- 🔗ip-adapter_sd15_vit-G.safetensors vit-G model bigG clip vision encoder required
- 🔗ip-adapter_sdxl.safetensors Basic model for SDXL
- 🔗ip-adapter-plus_sdxl_vit-h.safetensors Plus model for SDXL
- 🔗ip-adapter-plus-face_sdxl_vit-h.safetensors Face model for SDXL
- 🔗ip-adapter_sdxl.safetensors vit-G model for SDXL bigG clip vision encoder required
-
If you use FaceID, place the following model in
/ComfyUI/models/ipadapter.- 🔗ip-adapter-faceid_sd15 Basic model for FaceID
- 🔗ip-adapter-faceid-plusv2_sd15.bin Plus Model V2 for FaceID
- 🔗 Style transfer of text prompts for portrait for FaceID
- 🔗ip-adapter-faceid_sdxl.bin SDXL Basic Model for FaceID
- 🔗ip-adapter-faceid-plusv2_sdxl SDXL Plus Model V2 for FaceID
- 🔗ip-adapter-faceid-portrait_sdxl.bin Style transfer of text prompts for SDXL portrait for FaceID
- 🔗ip-adapter-faceid-portrait_sdxl_unnorm.bin Style transfer of text prompts for SDXL portrait for FaceID Very strong weights
*The Pyhon library insightface is required to use the FaceID model. Install the version appropriate for your environment using the -m pip install command. If it is already installed and an error occurs, reinstall it. Please note that insightface is a non-commercial license.
-
Python Version Checking: Open the root folder of ComfyUI Portabl (e.g. Users\username\ComfyUI_windows_portable) in a terminal. Execute the following command
python_embeded\python.exe -V - Download Library: Download the appropriate library for your version of Pyhon. 🔗For pyhon 3.10 🔗For pyhon 3.11
-
Update pip: Update pip with the following command.
python_embeded\python.exe -m pip install -U pip -
Installing insightface: Install the appropriate library for your version of Pyhon.
pyhon 3.10: python_embeded\python.exe -m pip install insightface-0.7.3-cp310-cp310-win_amd64.whl pyhon 3.11: python_embeded\python.exe -m pip install insightface-0.7.3-cp311-cp311-win_amd64.whl
ComfyUI IPAdapter plus main features list
- character reference: Generate image with characters from reference image
- Style transfer: Generate images using the style of the reference image
- Composition reference: Generate images using the screen configuration of the reference image
- Advanced Batch Processing: Set batch sizes, especially when creating videos, to reduce VRAM consumption
- Region Adjustment: Specific areas can be masked and controlled
- Schedule Weights: Schedule weights during video generation for smooth transitions
Example of using ComfyUI IPAdapter plus
A simple workflow for style references is available on DCAI’s Patreon for those interested in downloading it. Reference images are also available.
Utility-related custom nodes
ComfyUI-Custom-Scripts
”ComfyUI-Custom-Scripts” packs a variety of useful functions such as autocomplete, graph snapping, custom node colors, viewing detailed model information, and sound alerts.
How to install ComfyUI-Custom-Scripts
- Open “Custom Nodes Manager” from ComfyUI Manager.
-
Type
ComfyUI-Custom-Scriptsin the search field in the upper left corner.ComfyUI-Custom-Scripts - Click the “Install” button next to “Crystools” in the list to install.
- When installation is complete, a message for restarting ConfyUI will be displayed.
ComfyUI-Custom-Scripts main features list
- Autocomplete：Autocomplete function. It assists with prompt entry.
- Auto Arrange Graph：Graph auto-alignment. It aligns the layout of nodes with one click.
- Always Snap to Grid：Snap Function. It snaps the nodes to the grid of the canvas.
- Checkpoint/LoRA/Embedding Info：Right-click on a node in the model to view its info.
- Custom Colors：You can freely change the color of the nodes.
- Favicon Status：You can check the status of ComfyUI with the favicon.
- Image Feed：The generated images can be viewed at a glance. You can also drag and drop images to load workflows.
- Play Sound：It notifies you with a sound at the timing of node execution.
- System Notification：The browser will notify you when the node is about to be executed.
- Show Text：You can browse the TEXT of the nodes you have connected.
- String Function：Used to connect or replace multiple strings.
- Widget Defaults：You can edit the default value of a node.
ComfyUI-Crystools
“ComfyUI-Crystools” is a tool that allows you to comfortably use ComfyUI by displaying resource monitors, etc. on ConfyUI.
How to install ComfyUI-Crystools
- Open “Custom Nodes Manager” from ComfyUI Manager.
-
Type
Crystoolsin the search field in the upper left corner.Crystools - Click the “Install” button next to “Crystools” in the list to install.
- When installation is complete, a message for restarting ConfyUI will be displayed.
ComfyUI-Crystools main features list
- Resource Monitor: Displays CPU/GPU/RAM/VRAM utilization and GPU temperature/disk space
- ProgressBar: Progress bar on main menu to show graph progress
- Metadata: Extract and compare metadata from generated images
- Debugger: Extract and display metadata, prompts, and other data necessary for debugging
- Images: Extract and display data related to the image
- Pipe: Various wires are brought together and connected by a single wire.
- Primitive: Primitive Node Collection
- Switch: Nodes can be conditionally switched
Image Chooser
“Image Chooser” is a simple but powerful node. It allows you to select only the best images from a batch of generated images and pass them on to the next process. An example of its use would be to generate several low-resolution roughs and send only the best of them to Hires. Fix.
How to install Image Chooser
- Open “Custom Nodes Manager” from ComfyUI Manager.
-
Type
Image chooserin the search field in the upper left corner.Image chooser - Click the “Install” button next to “Image chooser” in the list to install.
- When installation is complete, a message for restarting ConfyUI will be displayed.
Image Chooser main features list
- Preview and Select: Only selected images from the generated images specified by batch size are advanced to the next process
- Mode Selection: Execution method can be changed by mode
- Hot Keys: Selected by 1-9 and proceed to the next process for the image selected by 0
- Alerts: A sound notification can be made when the image chooser node is in standby mode
- Support for Fabric custom nodes: Select positive/negative images for Fabric node *Already no longer supported but can be used
About Modes
- Alwayse pause: Default. Wait for image to be selected.
- Repeat last selection: If there is no change in the graph, the same image as the previous one is sent next. If there are any changes, it waits for the user to select an image.
- Only pause if batch: If the batch is 1, it is sent directly to the next batch; if the batch is 2 or more, it waits for an image to be selected.
- Progress first pick: Select the first one at any time and send the next one.
- Pass through: Send all images to the next
- Take First n: Send the first n images up to the next (n is specified by count)
- Take Last n: Send the nth image from the last to the next
Example of using Image Chooser
A simple workflow for Preview Chooser is available on DCAI’s Patreon for those interested in downloading it.
Use Everywhere (UE Nodes)
“Use Everywhere (UE Nodes)” is a tool that skips input values without drawing canvas wires and prevents the canvas from becoming cluttered with wires. If you lose track of the connections, you can also view them from the right-click menu.
How to install Use Everywhere (UE Nodes)
- Open “Custom Nodes Manager” from ComfyUI Manager.
-
Type
Use Everywhere (UE Nodes)in the search field in the upper left corner.Use Everywhere (UE Nodes) - Click the “Install” button next to “Use Everywhere (UE Nodes)” in the list to install.
- When installation is complete, a message for restarting ConfyUI will be displayed.
Use Everywhere (UE Nodes) main features list
- Anything Everywhere: Connects input data to where it is needed without wires
- Anything Everywhere3: Connects the three inputted data to the required locations without wires
- Anything Everywhere?: Connects input data to specified locations without wires
- Seed Everywhere: Connect the set seed to the required location without wires
- Prompts Everywhere: Connect the set prompts to the required locations without wires
Example of using Use Everywhere (UE Nodes)
Sample workflows of example usage patterns for Use Everywhere are available on DCAI’s Patreon for those interested in downloading them.
rgthree's ComfyUI Nodes
“rgthree’s ComfyUI Nodes” is a tool to make ComfyUI easier to use.
How to install rgthree’s ComfyUI Nodes
- Open “Custom Nodes Manager” from ComfyUI Manager.
-
Type
rgthree's ComfyUI Nodesin the search field in the upper left corner.rgthree's ComfyUI Nodes - Install from the “Install” button next to “rgthree’s ComfyUI Nodes” displayed in the list.
- When installation is complete, a message for restarting ConfyUI will be displayed.
rgthree’s ComfyUI Nodes main features list
- Progress Bar: A progress bar at the top of the canvas to show the progress of the graph (can be hidden from the settings).
- Seed Node: Can use the same format of Seed as A1111 WebUI
- Reroute Node: More advanced configuration than standard Reroute (see “Node Help” in the Node menu)
- Bookmark Node: Memorize the screen position by placing it at the upper left corner of the desired position on the canvas
- Context / Context Big Nodes: Advanced control over standard workflow
- Image Comparer Node: Compare two images connected to an input
- Power Lora Loader: Easy management of LoRA
- Power Prompt: More advanced settings than the standard CLIP Text Encode (Prompt) (LoRA and Embedding can be applied from a drop-down list)
AI Video-related custom nodes
ComfyUI-VideoHelperSuite
This custom node is essential if you want to generate videos with ComfyUI. Nodes necessary for creating videos from multiple images, loading videos, etc. are available.
How to install ComfyUI-VideoHelperSuite
- Open “Custom Nodes Manager” from ComfyUI Manager.
-
Type
ComfyUI-VideoHelperSuitein the search field in the upper left corner.ComfyUI-VideoHelperSuite - Click the “Install” button next to “ComfyUI-VideoHelperSuite” in the list to install.
- When installation is complete, a message for restarting ConfyUI will be displayed.
ComfyUI-VideoHelperSuite main features list
- Saving Video: Saving of multiple input images and videos
- Loading video: Load video files as image sequences
- Loading Image Sequence: Load the specified folder as an image sequence
- Video Integration: Output video from image sequence
- Loading Audio: Load audio by specifying a start time
- Latent image/pixel image node: Nodes for managing latent images and imagery
- Video Preview: Video preview is available
- Advanced Preview: Detailed preview available
ComfyUI-AnimateDiff-Evolved
“ComfyUI-AnimateDiff-Evolved” is a forked version of ArtVentureX / comfyui-animatediff. It is a powerful node pack for generating AI videos.
How to install ComfyUI-AnimateDiff-Evolved
- Open “Custom Nodes Manager” from ComfyUI Manager.
-
Type
AnimateDiff-Evolvedin the search field in the upper left corner.AnimateDiff-Evolved - Click the “Install” button next to “AnimateDiff-Evolved” in the list to install.
- When installation is complete, a message for restarting ConfyUI will be displayed.
- After installation, copy the following motion models to
ComfyUI/custom_nodes/ComfyUI-AnimateDiff-Evolved/models. Examplemm_sd_v15_v2.ckpt,v3_sd15_mm.ckpt, etc.
ComfyUI-AnimateDiff-Evolved main features list
- Compatible with all Ksampler: Compatible with all standard and custom Ksampler
- Support for Control Net, SparseCtrl, IPAdaptor: Generate high quality video using Control Net, SparseCtrl, and IPAdaptor
- Unlimited animation length: Sliding context sampling to eliminate AnimateDiff model’s 16-frame limit or HotshotXL’s 8-frame limit and set unlimited video duration across Unet.
- Scheduling context option: Adapt different parameters at specified points during sampling
- Advanced sampling options: FreeInit and FreeNoise for more advanced sampling
- Support for Motion LoRA: Support for 🔗official motion LoRA and civitai’s 🔗motion LoRA published by the original AnimateDiff
- Prompt Travel: 🔗FizzNodes can be introduced for t2v prompt travel using BatchPromptSchedule
- Adjust effects with multival input: Adjusted motion weights and impacts
- Custom noise scheduling: Customizable noise schedule with noise types, layers, etc.
- Support for AnimateDiff models: Support for AnimateDiff models V1/V2/V3
- Adaptation of multiple motion models: Gen2 node allows adaptation of multiple motion models
- Support for various motion modules: Support for 🔗HotshotXL 🔗AnimateDiff-SDXL 🔗AnimateLCM 🔗AnimateLCM-I2V 🔗CameraCtrl 🔗PIA
- AnimateDiff keyframe: Adjust weights and motion parameters with keyframes
- Support for fp8: Use of fp8 requires the latest ComfyUI and torch 2.1 or higher
Example of using ComfyUI-AnimateDiff-Evolved
A basic text2mov sample workflow is available on DCAI’s Patreon for those interested in downloading it.
The three sample workflows introduced here are connected to each other. If you have no time to look at them in order, please refer to the “ComfyUI Frame Interpolation (ComfyUI VFI)” sample workflow. All explanations are included.
To use the workflow, you will need the ComfyUI-VideoHelperSuite introduced earlier.
ComfyUI-Advanced-ControlNet
“ComfyUI-Advanced-ControlNet” is a custom node that adapts the standard ControlNet to animation.
How to install ComfyUI-Advanced-ControlNet
- Open “Custom Nodes Manager” from ComfyUI Manager.
-
Type
ComfyUI-Advanced-ControlNetin the search field in the upper left corner.ComfyUI-Advanced-ControlNet - Click the “Install” button next to “ComfyUI-Advanced-ControlNet” in the list to install.
- When installation is complete, a message for restarting ConfyUI will be displayed.
- Go to the following page to download the necessary pth file and place it in
/ComfyUI/models/controlnet.
ComfyUI-Advanced-ControlNet main features list
- Scheduling time steps and latent space strength: Control net strength adjusted on a time basis
- Attention Masks: Specify a mask for the area you want to draw attention to
- Prompt vs. control net weights: Adjustment of the weight balance between prompts and control nets implemented in A1111 WebUI
- Sliding Context Windows: Sampling method for stable video generation
-
Supporting control net type:
- ControlNets
- T2IAdapters
- ControlLoRAs
- ControlLLLite
- SparseCtrls
- SVD-ControlNets
Example of using ComfyUI-Advanced-ControlNet
A sample workflow for text2mov tile upscaling is available on DCAI’s Patreon for those interested in downloading it.
ComfyUI-VideoHelperSuite and ComfyUI-AnimateDiff-Evolved are required to use the workflow.
ComfyUI Frame Interpolation (ComfyUI VFI)
“ComfyUI-Frame-Interpolation” is a custom node that performs frame interpolation for multiple images and videos. When applied to videos with coarse frame layout, it can improve the quality of video generation and shorten the generation time.
How to install ComfyUI Frame Interpolation
- Open “Custom Nodes Manager” from ComfyUI Manager.
-
Type
ComfyUI Frame Interpolationin the search field in the upper left corner.ComfyUI Frame Interpolation - Click the “Install” button next to “ComfyUI Frame Interpolation” in the list to install.
- When installation is complete, a message for restarting ConfyUI will be displayed.
ComfyUI Frame Interpolation main features list
- Frame Interpolations: Frame interpolation of multiple input images and video
Example of using ComfyUI Frame Interpolation
A sample workflow for text2mov frame interpolation is available on DCAI’s Patreon for those interested in downloading it.
ComfyUI-VideoHelperSuite, ComfyUI-AnimateDiff-Evolved, and ComfyUI-Advanced-ControlNet introduced earlier are required to use the workflow.
Final results of sample workflow
The colors have been corrected while adding the logo.Conclusion
Although the number of introductions in this article may be a little smaller than those in the WebUI article, we have focused on custom nodes to cover basic usage. We will explain the detailed usage of each custom node in detail at another time.
