1580158
/
automatic
mirror of https://github.com/vladmandic/automatic
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
12,852 Commits
3 Branches
29 Tags
109 MiB
Commit Graph

182 Commits (5d835526309fbff8a8965bfe55c11bb95cce5577)

Author SHA1 Message Date
AI-Casanova fb4638288b
fix IndexError, change callback type 2024-11-08 23:31:52 -06:00
Vladimir Mandic 34d6d5f92b update 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-08 08:53:42 -05:00
AI-Casanova 3932d5fd1b
Move embedder object, cleanup stepwise lora 2024-10-30 23:24:50 -05:00
AI-Casanova 39dfa9cbdb
Scheduling and cleanup 2024-10-28 22:32:26 -05:00
AI-Casanova f3442abc92
Prompt LRU Cache 2024-10-26 18:47:11 -05:00
AI-Casanova 90e12b7880
Initial Prompt Refactor 2024-10-26 12:17:58 -05:00
Vladimir Mandic f4ed53c159 handle a1111 prompt scheduling 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-24 09:53:25 -04:00
Vladimir Mandic 7d7b2fcf00 add sd3.5 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-22 13:29:03 -04:00
Vladimir Mandic b37c6115ff fix sd3 loader 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-22 12:49:07 -04:00
Vladimir Mandic c2ab0b11c3 check te device 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-14 09:29:33 -04:00
Vladimir Mandic bd6e689bd1 fix te meta 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-01 21:26:21 -04:00
Vladimir Mandic 9a46d381cc cleanups 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-01 20:02:21 -04:00
Vladimir Mandic f9b5a83b49 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-01 12:20:32 -04:00
Vladimir Mandic 046d588de2 add fix-te 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-01 12:12:10 -04:00
Vladimir Mandic 92f2a2902f improve profiling 2024-09-23 11:07:24 -04:00
Vladimir Mandic b9e230c17f update logging 2024-09-22 11:17:06 -04:00
Vladimir Mandic 6919ca310a lint updates 2024-09-21 15:44:53 -04:00
Vladimir Mandic 2be087be38 embeds addiotional checks 2024-09-18 21:46:19 -04:00
Vladimir Mandic 8bd944d48b add move-te 2024-09-18 16:02:20 -04:00
Vladimir Mandic edd92c604e fix 2024-09-18 15:51:26 -04:00
Vladimir Mandic 2acb883dda jumbo update, see changelog 2024-09-18 13:48:30 -04:00
Vladimir Mandic 0d9ce663e4 post release dev merge, see changelog for details 2024-09-01 12:20:10 -04:00
Vladimir Mandic 2c8cb5cd67 vae exception handling 2024-08-29 17:46:32 -04:00
Vladimir Mandic 0b901e08ce xhinker move te as needed 2024-08-29 10:42:38 -04:00
Vladimir Mandic 707fc1de79 flux prompt attention 2024-08-28 08:34:42 -04:00
AI-Casanova 1de7716495
Remove print commands 2024-08-25 18:27:30 -05:00
AI-Casanova 517ee93e96
xhinker parser implementation 2024-08-25 18:23:45 -05:00
Disty0 c1285c6de6 Cascade re-add empty embed provider 2024-08-23 07:09:05 +03:00
Disty0 02d6b674c6 Cascade decide atten mask value from the model name 2024-08-23 02:53:39 +03:00
Disty0 8619a7f35c Better balanced offload 2024-08-14 11:53:35 +03:00
Disty0 70c2e84d26 Prompt cache support for Flux 2024-08-12 01:02:13 +03:00
Disty0 e3b087b6c0 Add balanced offload mode and make offload modes a single choice list 2024-08-11 17:27:30 +03:00
Disty0 6431296ec1 Fix Cascade empty prompt encode 2024-08-09 00:32:19 +03:00
Disty0 a17e452db2 Fix Cascade with long prompts 2024-08-07 01:32:09 +03:00
Vladimir Mandic 2cac5f365d update 2024-07-02 11:28:14 -04:00
Disty0 61d4acda68 SD3 send TE back to CPU when using cpu offload 2024-06-23 15:22:34 +03:00
Disty0 4d0ba8692a Add gc to prompt parser 2024-06-23 04:50:30 +03:00
Disty0 3856cb213a Fix SD3 prompt parser with offload 2024-06-22 15:43:58 +03:00
Vladimir Mandic 323b20813a fix prompt parsing 2024-06-21 08:58:33 -04:00
Vladimir Mandic 6b6170bfaa
Merge branch 'dev' into SD3-parsing 2024-06-21 08:16:44 -04:00
Vladimir Mandic 4e80e6c40c add option to disable text-encoder cache 2024-06-20 11:46:38 -04:00
Vladimir Mandic 9be91e2e2d update notes 2024-06-20 09:01:24 -04:00
AI-Casanova 1fcd378bd1
Merge branch 'dev' into SD3-parsing 2024-06-19 23:47:17 -05:00
AI-Casanova e3009753e3
Finish SD3 Prompt Parsing, reconfigure Compel Hijack 2024-06-19 23:41:11 -05:00
Vladimir Mandic ed8d2ee1d8 update changelog 2024-06-17 19:22:32 -04:00
AI-Casanova d3802f9fbc
SD3 Prompt Parsing, preliminary 2024-06-16 18:00:30 -05:00
Disty0 5f41181576 Cascade normalize padding and replace empty embed option with zeros 2024-06-13 03:13:45 +03:00
Vladimir Mandic a20103a86c add prompt attention normalization 2024-06-10 15:48:55 -04:00
Disty0 38c6dbdd4a Don't force empty padding on Cascade 2024-06-10 18:36:57 +03:00
Disty0 4f482986d1 Add empty prompt padding option 2024-06-10 17:59:07 +03:00
Vladimir Mandic 5574833f0d refactor backend detection 2024-06-06 20:41:10 -04:00
Vladimir Mandic 9bc217644d improve metadata parser 2024-06-06 11:24:31 -04:00
Vladimir Mandic 8a9c10e665 hidiffusion disable embeds cache 2024-06-05 17:36:43 -04:00
Disty0 887de74d22 Fix Cascade overcooking with more than 75 tokens 2024-05-31 18:40:39 +03:00
Disty0 3ebe2ab469 Fix prompt cache with clip skip 2024-05-26 18:15:38 +03:00
Disty0 be264d14d6 Stable Cascade prompt parser support 2024-05-26 16:01:27 +03:00
Vladimir Mandic 41efd6584d fix cached prompts 2024-05-24 09:46:18 -04:00
Vladimir Mandic 49c997e20f handle unknown tokens 2024-05-21 16:59:16 -04:00
Vladimir Mandic 4fa421ef90 add prompt caching and tokenizer info 2024-05-21 16:34:38 -04:00
Vladimir Mandic 7390815e07 minor prompt parse changes 2024-05-13 11:17:07 -04:00
Vladimir Mandic b137f67edc lint changes 2024-05-07 09:56:32 -04:00
Vladimir Mandic a4c6257124 full refactor of reference models 2024-03-12 23:51:36 -04:00
Vladimir Mandic 558463aeaf validate and fix all refiner workflows 2024-03-02 10:01:22 -05:00
Vladimir Mandic aec8f76c15 add differential-diffusion support for sd15 2024-02-20 13:14:32 -05:00
Vladimir Mandic ae4f7e6a5f regional prompting 2024-02-14 11:24:19 -05:00
AI-Casanova 33c8285e69 Experimental clip skip interpolation 2024-02-09 14:15:14 -05:00
Disty0 9a1ce4dd77 Adjust clip skip to expected range 2024-02-09 08:21:04 +03:00
Vladimir Mandic f56d210854 update clip-skip code 2024-02-08 19:40:26 -05:00
AI-Casanova e883348089 Fix offset 2024-02-08 18:41:28 -05:00
AI-Casanova 251373afca Hijacking Compel to enable clip skip 2024-02-08 18:41:28 -05:00
Vladimir Mandic 78722065e3 add batch embedding load 2024-01-17 10:28:05 -05:00
AI-Casanova ed9d3d93cc
Fix Long Prompts 
`extend` to `repeat`

Extend only works on singleton dimensions, mia culpa.
 2024-01-14 15:09:31 -06:00
AI-Casanova b10ea42506 Fix Early Out 2024-01-13 16:23:22 -06:00
AI-Casanova cc2e3e058b Fix Scheduling 2024-01-13 15:07:32 -06:00
AI-Casanova 1edecc2389 cleanup 2024-01-13 11:48:58 -06:00
Vladimir Mandic 204853afea global crlf to lf 2024-01-10 09:45:26 -05:00
Vladimir Mandic 5cfc044ec6 tracing and control improvements 2023-12-20 17:33:19 -05:00
Vladimir Mandic 8ceeee8b87 add trace logging 2023-12-20 10:17:39 -05:00
AI-Casanova ff94b197c1 Fix scheduling, lint 2023-12-18 23:42:31 -06:00
Vladimir Mandic f13f2d03f9 fix prompt scheduling 2023-12-18 13:27:36 -05:00
AI-Casanova 0b3e1f475d Fix batch & optimize 2023-12-17 19:37:05 -06:00
AI-Casanova 9e7757b7fe Fixes 2023-12-16 20:16:01 -06:00
AI-Casanova 2020d20bcb Prompt Scheduling 2023-12-16 18:07:20 -06:00
Vladimir Mandic 1b1ae6784c add demofusion 2023-12-09 14:15:48 -05:00
Vladimir Mandic f91735deac fix prompt parser with blank lines 2023-12-09 10:14:35 -05:00
Vladimir Mandic 9bd66e578a fix prompt padding 2023-11-25 10:16:03 -05:00
Vladimir Mandic 567b9dd435 offloading deal with meta tensors 2023-11-23 10:31:46 -05:00
Vladimir Mandic 096fd04f53 fix model offload on long prompts and update requirements 2023-11-23 09:42:24 -05:00
Vladimir Mandic 69c5cff112 diffusers prompt handle BREAK 2023-11-13 17:49:56 -05:00
Vladimir Mandic fab013d31c fix diffusers base/hires/refiner workflows 2023-10-22 11:11:28 -04:00
Vladimir Mandic 3727bf3d02 new lora handler and remove lyco 2023-10-05 14:30:58 -04:00
AI-Casanova 14914b9bfb
Fix Diffusers Prompt Padding and add pooled option 2023-10-03 20:31:50 -05:00
Vladimir Mandic ee794a137d change diffusers prompt attention 2023-10-02 15:20:09 -04:00
AI-Casanova 08d094bb95
Major Refactor prompt_parser_diffusers.py 
Prompt_2 has been mostly overridden by `TE2` keyword in prompt
 2023-10-01 15:52:42 -05:00
Vladimir Mandic e830b41dfa one more sdxl embeddings fix 2023-09-28 16:03:18 -04:00
Vladimir Mandic 14aec521ed better diffusers embedding handling 2023-09-26 12:04:26 -04:00
Vladimir Mandic d833b853ff downgrade diffusers 2023-09-15 13:41:56 -04:00
Vladimir Mandic 36001151bb ti fixes 2023-09-09 19:39:21 -04:00
Vladimir Mandic 81ff379e2c fix refiner 2023-09-07 09:38:35 -04:00
Vladimir Mandic 83ae2a6c42 fix pipe detection when processing prompts 2023-09-06 20:21:39 -04:00