diff --git a/CLiP-Skip.md b/CLiP-Skip.md new file mode 100644 index 0000000..521c868 --- /dev/null +++ b/CLiP-Skip.md @@ -0,0 +1,27 @@ +# CLiP Skip + +> [!WARNING] +Using CLiP skip values without understanding their implications can lead to unexpected and most likely corrupt image outputs. + +## What is a CLiP skip + +The CLiP text encoder model consists of multiple layers, each providing a different level of specificity +Lower Clip Skip values mean that more layers are used, resulting in images that closely match the prompts +Higher values skip some of these layers, leading to potentially more creative outputs but with less adherence to the original prompt + +Why did it became popular? Because original *NovelAI SD 1.5* model was trained with CLiP skip value of 2 +And that model was used as basis for many other anime-style models, leading to a common practice of using CLiP skip value of 2 for anime content + +However, anything newer than that, like pretty much *ANY* SDXL or FLUX or other recent model, +is trained with CLiP skip value of 1, and using CLiP skip value of 2 on these models will lead to bad results + +However, there are still many recommendations on the internet to use CLiP skip value of 2 - and most of them are outdated and wrong (unless we're talking about NAI SD 1.5 derivatives) +The problem arises from the fact that many SD applications such as original Automatic1111 do not even implement CLiP skip for SDXL and other newer models, so setting it to 2 does not change anything and does not lead to any issues + +SD.Next, on the other hand, does implement CLiP skip for all models, so setting it to 2 will lead to bad results with SDXL and other newer models + +If you want to experiment with CLiP skip values, you can do so, but be aware of the implications +To change the CLiP skip value, you need to unlock it in settings and then set it to the desired value + +> [!NOTE] +> SD.Next also supports non-integer CLiP skip values, such as 1.2, 1.5, etc. diff --git a/Home.md b/Home.md index 606c65a..ef6ff6b 100644 --- a/Home.md +++ b/Home.md @@ -59,6 +59,7 @@ Additionally, you can either download your own models or use built-in [CivitAI]( - [XYZ grid](XYZ-Grid) how-to: expertiment with different parameters - [Image processing](Process) overview: postprocess your existing images - [Image captioning and interrogation](Caption) overview: caption and interrogate your existing images +- What is [CLiP skip](CLiP-Skip) and how to use it - Intro to [IP Adapters](IPAdapter): image guidance - Work with [Models](Models-Tab): validate, convert, download, etc. - Supported [Video](Video) models: recommendations and limitations