DCAI
Loading Light/Dark Toggl

StableDiffusion webUI Explains how to use LoRA model for beginners

⏱️5min read
📅 May 08, 2024
🔄 Jul 26, 2024
Category:📂 Novice
StableDiffusion webUI Explains how to use LoRA model for beginners featured Image
Supported by

What is the Lora Model?

The Lora (Low-Rank-Adaption) model is one of Stable Diffusion’s training methods that allows you to orient AI illustrations to checkpoint models with very little data. This allows the original checkpoint model to be styled without straining storage.

We especially recommend it to anyone who is making AI illustrations and has a checkpoint model full of them.

PR
Image of Seagate Expansion Desktop 14TB, External Hard Drive, USB 3.0, 2 Year Rescue Services (STKP14000400)
Seagate Expansion Desktop 14TB, External Hard Drive, USB 3.0, 2 Year Rescue Services (STKP14000400)
🔗Amazon-Usa Link
Image of WD_BLACK 2TB SN850X NVMe Internal Gaming SSD Solid State Drive - Gen4 PCIe, M.2 2280, Up to 7,300 MB/s - WDS200T2X0E
WD_BLACK 2TB SN850X NVMe Internal Gaming SSD Solid State Drive - Gen4 PCIe, M.2 2280, Up to 7,300 MB/s - WDS200T2X0E
🔗Amazon-Usa Link

Download Lora Model

To find a model, go to 🔗Cibitai’s model page to find the model of your choice.

You can easily browse by using filters to narrow down your search to “Lora” models.

How to install the Lora model

As with NegativeEmbedding, all you have to do is put the file in the specified folder.

Here we will use Civatai’s popular “Detail Tweaker” model as an example. Please download the model from the link below.

Move the downloaded file to the \stable-diffusion-webui\models\Lora folder.

If you download various models, you will lose track of what is in the “Lora” folder, so we recommend that you create a child folder such as “Style” to keep the models organized.

Open the Web UI browser and open “Lora” in the Generation Parameters area.

If the file name add_detail of the “Detail Tweaker” that you just downloaded is not listed, press the refresh button on the right.

If add_detail appears in the list, the installation is complete.

How to use Lora Model UI

Model Search: If you want to search for a model, enter it here.
Sort by path: Sort the model list by file path.
Sort by name: Sort the model list by file name.
Sort by creation date: Sort the model list by file creation date.
Sorted by update date: Sort the model list by the date the file was last updated.
Sort in descending or ascending order: Sort the model list in descending or ascending order.
Switching tree view: If the \stable-diffusion-webui\model\Lora folder is further subdivided into child folders, activate this button to switch to the tree view.
Model update: Updates the listings on the “Lora” page. Use this page when you put in a new model, or after switching the base model from SD1.5 to SDXL.

How to use the Lora model

From the Lora page, click on “Detail Tweaker” to adapt it.

If <lora:add_detail:1> appears in the prompt area, it has been adapted with weight 1.

Detail Tweaker comparison image
Adapt the Detail Tweaker to control detail.
Open Image

About Lora Model Weights

The range of adaptation rates (weights) for the Lora model varies from model to model, so read the model descriptions.

For instance, the “Detail Tweaker” introduced here ranges -2 ~ 2. You can adjust the fineness of the AI illustration within the range of these numbers.

Detail Tweaker weight comparison image
You can control the effect of Lora by the number of weights.
Open Image

How to update the thumbnails in the Lora Model List

Thumbnails can be registered in the same way as on the “Textual Inversion” page.

Generate images with models in portrait (SD1.5 -> 512×768/ SDXL -> 768×1344) with txt2img.

Lora Model Edit Button
There is an edit button in the upper right corner of the card.
Open Image

Once the image you want to use as a thumbnail has been generated, open the model edit screen on the “Lora” page.

Press “Replace preview” to replace the image with the one you just generated.

If you want to remove the thumbnails, you can find the model name.png in the \stable-diffusion-webui\models\Lora folder and delete the PNG image to return to the initial state.

Conclusion

In this article, We have explained how to install and use the Lora model. Basically, model installation for Stable Diffusion Web UI is not particularly difficult since all you have to do is put the model into the specified folder. In our next article, We would like to introduce Lora’s recommended SD1.5 model.

PR
Image of ASUS TUF Gaming GeForce RTX 4090 24GB Gaming Graphics Card (DLSS 3, PCIe 4.0, 24GB GDDR6X, HDMI 2.1a, DisplayPort 1.4a, TUF-RTX4090-24G-GAMING)
ASUS TUF Gaming GeForce RTX 4090 24GB Gaming Graphics Card (DLSS 3, PCIe 4.0, 24GB GDDR6X, HDMI 2.1a, DisplayPort 1.4a, TUF-RTX4090-24G-GAMING)
🔗Amazon-Usa Link
Image of Corsair RM1000x Shift Fully Modular ATX Power Supply - Modular Side Interface - ATX 3.0 & PCIe 5.0 Compliant - Zero RPM Fan Mode - 105°C-Rated Capacitors - 80 Plus Gold Efficiency - Black
Corsair RM1000x Shift Fully Modular ATX Power Supply - Modular Side Interface - ATX 3.0 & PCIe 5.0 Compliant - Zero RPM Fan Mode - 105°C-Rated Capacitors - 80 Plus Gold Efficiency - Black
🔗Amazon-Usa Link
Supported by