1580158
/
Clip_IO
mirror of https://github.com/Filexor/Clip_IO.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
The extension allows you to investigate embeddings/conditioning and feed conditioning to Stable Diffusion.
26 Commits
2 Branches
0 Tags
207 KiB
Python 100%
 
Go to file
File_xor 4e815714d1 Add Directive mode to Clip Input 2023-06-06 20:39:33 +09:00
conditioning Add ability to include tokens to on_save_embeddings_as_csv 2023-05-19 02:02:05 +09:00
scripts Add Directive mode to Clip Input 2023-06-06 20:39:33 +09:00
.gitignore Add embeddings export functions. 2023-04-26 01:48:22 +09:00
LICENSE Replace LICENSE with AGPL 2023-06-03 22:28:28 +09:00
README.md Update README.md 2023-06-03 23:02:34 +09:00

README.md

Clip I/O

Clip I/O is extension of Stable diffusion Web UI. This extension allows you to investigate embeddings/conditioning and feed conditioning to Stable Diffusion.

Clip Output

Clip Output allows you to export embeddings/conditioning whitch processed by Clip for investigation.

Options

Transpose matrix

Swap column (token axis) and row (dimension axis).

Don't add bos / eos / pad tokens

In default settings, automatically append pad (padding) tokens to make chunk 75 tokens long then prepend bos (start of text) token and append eos (end of text) token.
This option disables that behavior.

Ignore emphasis

This option makes multiplier of all tokens to 1.0 .
Note that unlike disabling Settings -> Stable Diffusion -> Enable emphasis, emphasis syntax is still parsed.

Bypass conditioning normalization

In default settings, mean average of emphasized conditioning will be adjusted to match mean average of pre-emphasized conditioning.
This option disabled that behavior.

Add token strings

Add token string for readability.
Location of token string is affected by "Transpose matrix" option.

Overwrite

Overwrite pre-existing file with same name as Output name.

Clip Input

Clip Input is, in spite of its name, bypasses Clip and allows you to feed your conditioning to Stable Diffusion model.
This is useful not just for investigation, but using special conditioning which is impossible with using Clip.
e.g. Combining two conditionings which exported with different Clip Skip settings.

How to use

  1. Expand "Clip Input" accordion.
  2. Enable "Enable" checkbox.
  3. Select "Positive/Negative prompt mode". Note: Clip Input uses Positive/Negative Prompt textbox. For syntax, see section below.

Syntax for "Simple" mode

Each space-separated text represents file in /extensions/Clip_IO/conditioning/ .
For filename without extension, if it does not exist, will searched with appending ".csv" or ".pt" in that order.
If filename has space, you can enclose with single double-quotation or single single-quotation.
You can include prompt which to be processed by Clip, by enclosing prompt with triple double-quotation or triple single-quotation.
After gathering all conditionings, these conditionings will be concaterated.