Flux Block Lora Select + Lora Loader

[caniyabanci76]

Hi,

I noticed these nodes under Experimental. Do you have a quick explanation as to how they're meant to be used? Thanks.

[kijai]

It's quite experimental, but seems to work. It simply sets the LoRA alpha value individually for each block. Value of 0 drops the whole block from the LoRA. This can be used to test the influence of specific blocks, it affects the actual weights loaded so you can also then save the model/extract new LoRA.

Note that the values are the alpha values, with kohya trained LoRAs alpha values are saved in the LoRA itself, with some trainers it's not saved and then the default would be the LoRA rank.

[vigee88]

It's quite experimental, but seems to work. It simply sets the LoRA alpha value individually for each block. Value of 0 drops the whole block from the LoRA. This can be used to test the influence of specific blocks, it affects the actual weights loaded so you can also then save the model/extract new LoRA.

Note that the values are the alpha values, with kohya trained LoRAs alpha values are saved in the LoRA itself, with some trainers it's not saved and then the default would be the LoRA rank.

May I ask how to get lora's rank？Some Loras don't seem to be standard sizes
For example, a rank of 299MB is 32, but what is the rank of 82MB? Is there any tool available for viewing?

[kijai]

It's quite experimental, but seems to work. It simply sets the LoRA alpha value individually for each block. Value of 0 drops the whole block from the LoRA. This can be used to test the influence of specific blocks, it affects the actual weights loaded so you can also then save the model/extract new LoRA.
Note that the values are the alpha values, with kohya trained LoRAs alpha values are saved in the LoRA itself, with some trainers it's not saved and then the default would be the LoRA rank.

May I ask how to get lora's rank？Some Loras don't seem to be standard sizes For example, a rank of 299MB is 32, but what is the rank of 82MB? Is there any tool available for viewing?

There's an output from the loader node that should detect it, you'll need some node to display it like "Display Anything".

[vigee88]

It's quite experimental, but seems to work. It simply sets the LoRA alpha value individually for each block. Value of 0 drops the whole block from the LoRA. This can be used to test the influence of specific blocks, it affects the actual weights loaded so you can also then save the model/extract new LoRA.
Note that the values are the alpha values, with kohya trained LoRAs alpha values are saved in the LoRA itself, with some trainers it's not saved and then the default would be the LoRA rank.

May I ask how to get lora's rank？Some Loras don't seem to be standard sizes For example, a rank of 299MB is 32, but what is the rank of 82MB? Is there any tool available for viewing?

There's an output from the loader node that should detect it, you'll need some node to display it like "Display Anything".

Sorry to bother you again, but I am unable to use the Display Anything node to obtain information about Lora. Is there a problem with my settings?

[kijai]

I meant my node that's used to select the blocks: