1580158
/
automatic
mirror of https://github.com/vladmandic/automatic
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
12,597 Commits
3 Branches
29 Tags
109 MiB
Commit Graph

1527 Commits (0e0b607cfaabf59167e3ab2a44d491b4e4e1b08e)

Author SHA1 Message Date
Vladimir Mandic e7f0047d52 add granular vae tiling options 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-25 12:38:21 -05:00
Vladimir Mandic 7d663249e8 move postprocessing scripts to accordions 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-23 12:23:18 -05:00
Disty0 6d3d23bddd OpenVINO disable model caching by default 2024-12-23 00:16:34 +03:00
Vladimir Mandic 0803946c08 update changelog and cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-19 11:34:19 -05:00
Vladimir Mandic a7e0723dcf profiling 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-18 13:02:22 -05:00
Vladimir Mandic fd7fe8cea5 add torchao 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-17 13:29:36 -05:00
Vladimir Mandic b1f1864099 lint updates 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-15 13:12:35 -05:00
Vladimir Mandic 3e8dec9297 add freescale 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-15 12:40:54 -05:00
Vladimir Mandic e9f951b2c5 offload logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-11 14:20:01 -05:00
Vladimir Mandic c3b0c0a3bf add SD_NO_CACHE env variable 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-11 12:32:34 -05:00
Vladimir Mandic 9a588d9c91 update balanced offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-11 12:06:03 -05:00
Vladimir Mandic f4847f1b8a optimize balanced offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-10 15:49:20 -05:00
Vladimir Mandic beea969fd3 update lora 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-10 12:34:27 -05:00
Vladimir Mandic 944408e93b warn on quanto with offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-10 10:39:13 -05:00
Vladimir Mandic 042178fedb reorg settings 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-10 10:20:00 -05:00
Vladimir Mandic 1185950c4a yet another lora refactor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-09 13:40:19 -05:00
AI-Casanova 6c9101dfaf
lora low memory mode: switching requires manual model reload 2024-12-06 22:54:08 -06:00
Vladimir Mandic 2965045993 change offload and upcast defaults 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-05 07:58:55 -05:00
Vladimir Mandic cfafa2b271
Merge branch 'dev' into lora-refactor 2024-12-02 11:23:15 -05:00
Vladimir Mandic 4eac263055 add bdia sampler 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-02 11:21:39 -05:00
Vladimir Mandic 7e2034c4ff lora add fuse 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-02 10:51:41 -05:00
Disty0 82eb924486 Reduce balanced offload max gpu memory to 0.70 2024-12-02 00:29:01 +03:00
Vladimir Mandic 023b13b6cb balanced offload improvements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-01 15:34:25 -05:00
Vladimir Mandic b7aff134a2 add low/high threshold to balanced offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-30 19:03:51 -05:00
Disty0 6ec93f2d46 Disable load lora gpu with medvram too 2024-11-30 17:04:35 +03:00
Disty0 63ba83d361 ZLUDA enable Dynamic attention by default 2024-11-30 01:15:49 +03:00
Vladimir Mandic 6aa7a4707e modules.lora full integration 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-29 09:39:38 -05:00
Vladimir Mandic d6c1487f9a
Merge branch 'dev' into lora-refactor 2024-11-29 07:50:55 -05:00
Vladimir Mandic b74166f9cb detailer add augment setting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-29 07:18:07 -05:00
Vladimir Mandic 164ce252dc add sd35 controlnets 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-28 08:46:10 -05:00
Vladimir Mandic 00ebdf3476 fix api scripts callbacks 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-27 10:07:37 -05:00
AI-Casanova cb561fa486
Major lora refactor: works on my machine edition 2024-11-23 21:57:03 -06:00
Vladimir Mandic 62c53942e0 post release jumbo patch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-22 12:55:18 -05:00
Vladimir Mandic c5b1fb36a5 relax settings validator 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-21 20:29:16 -05:00
Vladimir Mandic 96ae1ec019 set default flowmatch shift value 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-18 14:26:08 -05:00
Vladimir Mandic 59cd08f5da update docker and progress monitoring 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-16 10:49:08 -05:00
Vladimir Mandic 4110bc746b param validation 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-14 13:19:34 -05:00
Vladimir Mandic 8d50661291 add docker support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-13 17:28:04 -05:00
Vladimir Mandic adec80861b fix validation 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 13:20:01 -05:00
Vladimir Mandic e2c7c8cf2e refactor processing class 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:19:12 -05:00
Vladimir Mandic 0cf3283ac8 update docs 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:18:33 -05:00
Vladimir Mandic 66820edb63 update 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:02:34 -05:00
Vladimir Mandic 29f5202811
Merge branch 'dev' into refactor-prompt 2024-11-06 10:58:03 -05:00
Vladimir Mandic f2ae3c1599 optimize initial networks display 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-02 09:30:52 -04:00
Vladimir Mandic 2c43d52fac detailer min/max size as fractions of image size 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-01 10:11:27 -04:00
Vladimir Mandic 4473f538bd changelog management, move assets 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-31 10:37:42 -04:00
AI-Casanova f3442abc92
Prompt LRU Cache 2024-10-26 18:47:11 -05:00
Vladimir Mandic 6760632f38 major model load refactor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-26 13:22:29 -04:00
Vladimir Mandic dbb9ba0890 cuda memory limits 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-26 07:51:40 -04:00
Vladimir Mandic 1ad8ca1d58 change model selector 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-25 11:23:41 -04:00
Disty0 3acf6013f6 OpenVINO add accuracy option 2024-10-24 19:28:15 +03:00
Disty0 801ebdd080 Treat Zluda as a different backend and auto disable BF16 for Zluda and ROCm on RDNA1-2 2024-10-24 15:06:39 +03:00
Vladimir Mandic a95a394234 fix styles migration 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-23 06:38:24 -04:00
Vladimir Mandic e09423bc3f update settings 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-22 15:56:57 -04:00
Vladimir Mandic 1b329a6570 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-22 15:55:25 -04:00
Vladimir Mandic f191134aa6 support bnb quantization during load 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-22 15:43:09 -04:00
Vladimir Mandic 56ec09fac8 add detailer multi-class support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-21 10:57:19 -04:00
Vladimir Mandic ae4591ac0b reimplement torchao quantization 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-18 09:34:04 -04:00
brknsoul 918174e307
Update shared.py 
added autolaunch option
 2024-10-18 13:42:07 +10:30
Vladimir Mandic d15f66619c add support for torch expandable segments 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-15 12:52:42 -04:00
Vladimir Mandic 9de22ebcc7 ensure lora is not first to use quans 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-13 08:47:33 -04:00
Disty0 9c05124c33 Add devices.has_xpu() 2024-10-13 15:13:38 +03:00
Disty0 011d9c3348 Move device backed initialization to shared.py 2024-10-13 14:56:28 +03:00
Vladimir Mandic 0c54c235cb add sageattention 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-12 15:43:34 -04:00
Vladimir Mandic 3e6f7850f8 cleanup config 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-12 14:20:19 -04:00
Vladimir Mandic 69d3a95b12 fix adetailer 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-10 06:41:58 -04:00
Vladimir Mandic 723ce74986 add linfusion 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-09 11:01:16 -04:00
Vladimir Mandic f17fbe096d fix corner-case model load on startup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-09 08:36:52 -04:00
Vladimir Mandic a722ed30d9 fix face restore dependend extensions 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-08 13:11:34 -04:00
Vladimir Mandic 2e08a26d53 add latent history 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-08 09:23:16 -04:00
Vladimir Mandic a3a177277a history prototype 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-07 19:09:44 -04:00
Vladimir Mandic e1a522892a update modernui for detailer 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-07 10:15:58 -04:00
Vladimir Mandic 3bbcc33181 add detailer 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-07 09:32:56 -04:00
Vladimir Mandic 04a5071249 face-hires -> detailer refactor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-06 11:23:33 -04:00
Vladimir Mandic 3cd584b35b fix en height 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-04 16:03:14 -04:00
Vladimir Mandic 176c5c5773 sampler options rewrite 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-03 09:38:38 -04:00
Vladimir Mandic 9a46d381cc cleanups 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-01 20:02:21 -04:00
Vladimir Mandic 046d588de2 add fix-te 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-01 12:12:10 -04:00
Vladimir Mandic ac58b21d06 update flux lora code 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-09-30 10:16:02 -04:00
Vladimir Mandic fce431b1bd
Merge branch 'dev' into flux-lora 2024-09-30 08:34:15 -04:00
Vladimir Mandic d0f94503b5 logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-09-29 20:32:02 -04:00
Vladimir Mandic 47755dce6b refactor devices 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-09-29 20:17:03 -04:00
AI-Casanova bd5ac8e048
Add option, fix diffusers keys 2024-09-29 15:56:53 -05:00
Vladimir Mandic fe94edf781 set default cuda dtype to auto 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-09-29 14:16:14 -04:00
Vladimir Mandic e7e79c4870 add lora_load_gpu setting 2024-09-25 18:05:53 -04:00
Vladimir Mandic ddefb38030 cleanup lora detect 2024-09-22 19:50:57 -04:00
Vladimir Mandic 6919ca310a lint updates 2024-09-21 15:44:53 -04:00
Vladimir Mandic 419f34272f add gradio_skip_video setting 2024-09-21 08:39:36 -04:00
Vladimir Mandic 2acb883dda jumbo update, see changelog 2024-09-18 13:48:30 -04:00
Vladimir Mandic 55148445f7 lora auto-apply tags 2024-09-15 12:28:39 -04:00
Vladimir Mandic a6136a6eec disable offloading for backend=original 2024-09-14 10:38:51 -04:00
Vladimir Mandic c07e7c765d flag backend=original 2024-09-14 10:38:06 -04:00
Vladimir Mandic a92e1ce664 enable full resize opts in hires 2024-09-08 12:32:45 -04:00
Vladimir Mandic 605e5f67aa add context-aware image resize 2024-09-07 11:58:58 -04:00
AI-Casanova d1d0cdecb2
Implement seam-carving 2024-09-06 18:34:04 -05:00
Vladimir Mandic f2c5cbbb36 lint updates and diffusers installer 2024-09-06 14:10:53 -04:00
Vladimir Mandic b4df9a4de1 jumbo update with flux.1 refactor, see changelog for details 2024-09-01 22:56:15 -04:00
Vladimir Mandic 0d9ce663e4 post release dev merge, see changelog for details 2024-09-01 12:20:10 -04:00
Vladimir Mandic 9d142581b9 flux nf4 offline load 2024-08-31 11:46:41 -04:00
Vladimir Mandic a11a5f0562 flux qint auto-download quantization map 2024-08-31 07:51:08 -04:00
Vladimir Mandic ed52624bef
Merge branch 'dev' into xhinker 2024-08-28 08:11:52 -04:00
Vladimir Mandic 5ed58ac7cc end-to-end update flux, see changelog and wiki 2024-08-28 08:04:24 -04:00
AI-Casanova 517ee93e96
xhinker parser implementation 2024-08-25 18:23:45 -05:00
Disty0 2caf52a546 Update Quanto settings names 2024-08-21 19:25:38 +03:00
Disty0 16d6c03d45 Optimum Quanto activations support 2024-08-21 17:30:45 +03:00
Disty0 b025d1dab1 Round memory size in settings 2024-08-19 18:56:28 +03:00
Disty0 cc89ed84f9 Rename cpu offload to model offload 2024-08-19 18:48:09 +03:00
Disty0 2586a18218 Don't add 0.1 to the GPU memory 2024-08-18 13:18:24 +03:00
Disty0 a3f26c9df0 Convert Dynamic Attention SDP to a global SDP option 2024-08-18 01:44:27 +03:00
Disty0 bce3c7eabf Fix --Xvram flags not activating offload 2024-08-18 00:23:15 +03:00
Disty0 8699e0cacb Add gc to balanced offload 2024-08-14 17:37:07 +03:00
Disty0 8619a7f35c Better balanced offload 2024-08-14 11:53:35 +03:00
Disty0 0f7b7e83bc Fix memory detection when no gpu is present 2024-08-12 01:41:54 +03:00
Disty0 fb89e26b54 Auto detect memory size ffor balaced offload 2024-08-11 19:01:49 +03:00
Disty0 e3b087b6c0 Add balanced offload mode and make offload modes a single choice list 2024-08-11 17:27:30 +03:00
Disty0 dc9e60aa67 Quant add shuffle models option 2024-08-04 04:46:06 +03:00
Disty0 b50a8601fe Fix T5 INT8 and add QINT8 2024-07-30 18:23:21 +03:00
Disty0 6c75bcca0a Optimum Quanto support 2024-07-30 17:35:56 +03:00
Vladimir Mandic 6ad519e51f css 2024-06-22 20:16:32 -04:00
Vladimir Mandic e8165c3d63 xyz grid add lora selector 2024-06-22 18:40:06 -04:00
Vladimir Mandic 4e80e6c40c add option to disable text-encoder cache 2024-06-20 11:46:38 -04:00
Disty0 eb6e3c337c NNCF ControlNet support 2024-06-19 22:42:00 +03:00
Disty0 bf9565cb46 NNCF compression support on CPU and add INT8 option for T5 2024-06-19 21:23:47 +03:00
Vladimir Mandic 0de6be4621 fix save style without name 2024-06-17 11:03:24 -04:00
Vladimir Mandic bbaa03a466 add 4bit t5 2024-06-17 09:39:30 -04:00
Vladimir Mandic deefbe59a4 sd3 sampler shift support 2024-06-16 15:56:25 -04:00
Vladimir Mandic 26cff4557c handle fallback theme 2024-06-16 08:00:35 -04:00
Vladimir Mandic 6e01d510d4 add sd3 2024-06-12 21:02:48 -04:00
Disty0 5f41181576 Cascade normalize padding and replace empty embed option with zeros 2024-06-13 03:13:45 +03:00
Vladimir Mandic a20103a86c add prompt attention normalization 2024-06-10 15:48:55 -04:00
Disty0 4f482986d1 Add empty prompt padding option 2024-06-10 17:59:07 +03:00
Vladimir Mandic db9718eee6 add torch full deterministic mode 2024-06-07 09:26:51 -04:00
Vladimir Mandic 5574833f0d refactor backend detection 2024-06-06 20:41:10 -04:00
Vladimir Mandic e15c21ede9 facehires implement include mask in output 2024-06-04 07:56:46 -04:00
Vladimir Mandic 99bddca5c1 fix control prompt lists 2024-05-29 13:48:07 -04:00
Vladimir Mandic 9b08e720a5 better image save reporting 2024-05-17 10:10:52 -04:00
Vladimir Mandic d63f35e298 add cudaMallocAsync 2024-05-16 18:02:55 -04:00
Vladimir Mandic 8b8d91f3e4 update 2024-05-15 11:31:27 -04:00
Vladimir Mandic eb34241ca9 enhance metadata handling 2024-05-15 10:08:31 -04:00
Vladimir Mandic 76cbf11559 cache diffusers model config 2024-05-14 12:54:34 -04:00
Vladimir Mandic 6733f3437a move face restore settings 2024-05-14 11:34:51 -04:00
Vladimir Mandic 6d85980c56 face-hires improvements 2024-05-13 17:46:25 -04:00
Vladimir Mandic f958ca0c21 add wildcards 2024-05-12 11:53:25 -04:00
Vladimir Mandic 51f9c3a99b en default sort and disable hypernet by default 2024-05-12 08:52:34 -04:00
Disty0 66de7597d1 OpenVINO disable upscaler compile by default 2024-05-12 14:08:41 +03:00
Vladimir Mandic eff5dce05f new sampler features 2024-05-11 12:53:45 -04:00
Vladimir Mandic e7b30ef662 a1111 optioninfo compatibility 2024-05-10 08:46:38 -04:00
Vladimir Mandic a697366951 tunable force lora loading method 2024-05-06 20:20:59 -04:00
Vladimir Mandic c42fded960 add pag for sd15 and sdxl 2024-05-06 19:57:40 -04:00
Vladimir Mandic 9ff507d93a add todo token downsampling and simplify tomes 2024-04-28 20:29:28 -04:00
Vladimir Mandic a26d222cc1 add load unet override 2024-04-28 11:51:08 -04:00
Seunghoon Lee f05ef954a6
Improve ZLUDA instllation. 2024-04-28 15:52:15 +09:00
Vladimir Mandic 729260b17a modernui support 2024-04-26 12:10:23 -04:00
Vladimir Mandic a38d755e8d hidiffusion optimizations; support for xyz grid; variable aspect ratios 2024-04-25 16:18:55 -04:00
Vladimir Mandic 5914f1e00d add hidiffusion 2024-04-24 10:48:47 -04:00
Disty0 a8b2d0b8c9 Update defaults and add autodetect for VRAM optimizations 2024-04-21 00:53:31 +03:00
Vladimir Mandic e900adf5ee cleanup 2024-04-20 11:48:44 -04:00
Vladimir Mandic f2610c3936 ip adapter masking 2024-04-18 12:43:51 -04:00
Vladimir Mandic 744391af7e add euler sgm preset 2024-04-13 11:49:03 -04:00
Vladimir Mandic 2f7154dc70 add option for fully random batch seeds 2024-04-09 10:46:33 -04:00
Vladimir Mandic 3ddf5751f5 improve support for manually downloaded controlnets 2024-04-07 12:03:18 -04:00
Disty0 29e5d88e37 Add migraphx compile backend 2024-04-05 18:13:20 +03:00
Seunghoon Lee ce2bb713d8
add partial support of zluda dnn 2024-04-04 02:51:10 +09:00
Vladimir Mandic 2fca1c92d7 fix theme capitalization 2024-04-02 09:28:06 -04:00
Vladimir Mandic bf8a044f7b add theme type 2024-03-30 11:44:42 -04:00
Vladimir Mandic 25bc3c9bb6
Merge pull request #3000 from aifartist/dev 
Partial support for onediff
 2024-03-25 15:00:43 -04:00
Vladimir Mandic fb5ef75f5a gallery video support 2024-03-24 13:18:39 -04:00
Vladimir Mandic dc9c60e174 gallery optimizations 2024-03-23 14:46:55 -04:00
Vladimir Mandic 3efc93b90e prompt paste improvements 2024-03-22 09:41:15 -04:00
Vladimir Mandic 6252f6673b pre gallery cleanup 2024-03-21 16:16:39 -04:00
Vladimir Mandic 695a2cb871 post merge items 2024-03-19 16:45:52 -04:00
aifartist 58fefbeb65 Partial support for onediff 2024-03-18 16:34:50 -07:00
Vladimir Mandic c54369bcba add resize modes to control plus simple outpaint 2024-03-17 09:11:00 -04:00
Vladimir Mandic 48d763693c multiple control fixes 2024-03-16 11:11:27 -04:00
Disty0 8c7ba2fdde IPEX disable IPEX Optimize by default 2024-03-14 22:30:55 +03:00
Vladimir Mandic 940b6d02ba facehires support batch size&count, add override strength 2024-03-14 11:40:58 -04:00
Vladimir Mandic a4c6257124 full refactor of reference models 2024-03-12 23:51:36 -04:00
Vladimir Mandic 9873178897 add extra_network_reference setting, refactor geninfo parser 2024-03-11 11:15:51 -04:00
Vladimir Mandic 8620ba5310 fix control final resize 2024-03-10 13:58:21 -04:00
Vladimir Mandic 0f7bb8a1f4 add facehires 2024-03-10 13:17:13 -04:00
Disty0 06149c4a41 ROCm add Flash Attention support 2024-03-10 00:11:50 +03:00
Vladimir Mandic c671bf2817 allow custom aspect ratio values 2024-03-06 14:36:38 -05:00
Vladimir Mandic 7304deaffb add user watermarks option 2024-03-05 17:25:16 -05:00
Vladimir Mandic 558463aeaf validate and fix all refiner workflows 2024-03-02 10:01:22 -05:00
Vladimir Mandic c29b76fde3 cleanup api 2024-03-02 08:59:35 -05:00
Vladimir Mandic 17f2f8d98f add include mask in output, improve model offload compatibility 2024-02-24 11:06:14 -05:00
Seunghoon Lee a02052cd6a improve zluda installation 2024-02-23 09:55:48 -05:00
Vladimir Mandic 1bbcf2e13d minor fixes 2024-02-23 08:54:32 -05:00
Vladimir Mandic 9d1a827900
Merge branch 'master' into dev 2024-02-22 13:57:11 -05:00
Vladimir Mandic e64055cc01 handle installer exceptions and update requirements 2024-02-22 13:07:31 -05:00
Vladimir Mandic 44dace8fe6 change gradio textbox handler to submit+unfocus instead of keypress 2024-02-20 11:26:08 -05:00
Vladimir Mandic ee7517dfb8 expose sdp options 2024-02-19 08:29:24 -05:00
Seunghoon Lee 8ae3b5bb43
remove zluda force sync 2024-02-17 20:56:10 +09:00
Seunghoon Lee 6e412d406b
add zluda force sync 2024-02-17 16:16:11 +09:00
Vladimir Mandic 5ffc692b17 update theme cli param 2024-02-16 09:27:44 -05:00
Vladimir Mandic b28fd28d2f lora strict filename matching 2024-02-15 11:35:12 -05:00
Seunghoon Lee cc4438651f
Initial ZLUDA support. 2024-02-15 07:38:49 +09:00
Disty0 a956be05f7 OpenVINO add disable memory cleanup option 2024-02-14 20:29:58 +03:00
Disty0 3f8da51eac Set default atten for ROCm to SDP 2024-02-11 13:44:39 +03:00
Disty0 1ff909fcfb Add option to use HyperTile on only hires pass 2024-02-11 01:24:16 +03:00
Disty0 ef909cd003 HyperTile add swap size and depth options 2024-02-10 22:12:47 +03:00
Vladimir Mandic 304caf8c06 update cross-attention 2024-02-10 10:45:10 -05:00
Disty0 43c5be76ca Unite attention optimization settings 2024-02-10 10:32:53 -05:00
Vladimir Mandic bf14e6ed6d fix mask missing options and system paths 2024-02-10 08:10:24 -05:00
Disty0 d867e7aa2d Diffusers add Dynamic Attention Slicing 2024-02-09 13:49:46 +03:00
Disty0 9a1ce4dd77 Adjust clip skip to expected range 2024-02-09 08:21:04 +03:00
Vladimir Mandic c9444c8bd9 cleanup 2024-02-08 20:06:31 -05:00
Vladimir Mandic 312f391550 add theme cli arg 2024-02-08 18:23:20 -05:00
Vladimir Mandic f3be294d53 add deep-cache support 2024-02-08 12:56:06 -05:00
Vladimir Mandic d5a4f43f43 post release jumbo update 2024-02-08 12:10:32 -05:00
Vladimir Mandic 24b4cd77a3 update benchmarks and api endpoints 2024-02-07 12:12:54 -05:00
Disty0 ad47d81da7 OpenVINO fix cache and Lora loading 2024-02-06 19:18:49 +03:00
Vladimir Mandic b3f6f24ba1 cleanup 2024-02-06 10:01:15 -05:00
Vladimir Mandic e2e6743fbc fix masking 2024-02-04 21:15:12 -05:00
Seunghoon Lee b0553f6ccc
Add tooltips for DirectML & ONNX/Olive. 2024-02-04 14:48:48 +09:00
AI-Casanova 5c9ca793e9 First Callback Commit 2024-02-02 18:38:30 -05:00
Seunghoon Lee fcf00bd854
move initialization of onnx pipelines & create onnx folder automatically 2024-02-02 05:20:46 +09:00
Seunghoon Lee c26c53a9ad
premerge 1 2024-02-01 01:20:16 +09:00
Seunghoon Lee 6a6d282a5d
fix 2024-02-01 01:13:25 +09:00
Seunghoon Lee 49b13b9526
Restruct ONNX-related files & change olive-ai to optional dependency. 2024-02-01 01:13:25 +09:00
Seunghoon Lee ea2ac32cf2
ONNX/Olive support .safetensors VAE. 2024-02-01 01:13:23 +09:00
Seunghoon Lee 701c6564ed
ONNX/Olive SD/SDXL Img2Img Fix. 
ONNX/Olive cache management.
 2024-02-01 01:13:22 +09:00
Seunghoon Lee 3fb21306f6
ONNX Stable Diffusion Inpaint WIP 
ONNX Stable Diffusion XL Img2Img WIP
ONNX Stable Diffusion XL Refiner WIP
and lots of fixes.
 2024-02-01 01:13:21 +09:00
Seunghoon Lee 364c3beb2e
Fix onnx model downloading & more fixes. 2024-02-01 01:13:21 +09:00
Seunghoon Lee 4e5f0d3dde
Add static dims option. 2024-02-01 01:13:21 +09:00
Seunghoon Lee 286ec8e753
Integrate Olive into compile backend. 2024-02-01 01:13:19 +09:00
Seunghoon Lee 82523bd799
separate onnx & add pipeline for SDXL Img2Img 2024-02-01 01:13:19 +09:00
Seunghoon Lee 5b2f77811c
reduce memory usage (conversion/optimization) 2024-02-01 01:13:17 +09:00
Seunghoon Lee c8814c4898
img2img wip 2024-02-01 01:13:16 +09:00
Seunghoon Lee 6507491d8f
refactor onnx and olive 2024-02-01 01:13:14 +09:00
Disty0 8c819df207
ONNX OpenVINO fixes 2024-02-01 01:13:00 +09:00
Seunghoon Lee 84f2a9df95
make olive optional 2024-02-01 01:12:58 +09:00
Seunghoon Lee ae5e40785e
fix ep option save 2024-02-01 01:12:11 +09:00
Seunghoon Lee 98ee5848f2
customizable execution provider. 2024-02-01 01:12:10 +09:00
Seunghoon Lee b22d5521b7
optimized model downloading 2024-02-01 01:12:08 +09:00
Seunghoon Lee ff6acb4e3f
olive_cache_optimized 2024-02-01 01:12:08 +09:00
Seunghoon Lee def8a30017
Initial Olive implementation. 2024-02-01 01:12:07 +09:00
Vladimir Mandic 09d1f1e788 add sa solver and prototype instaflow 2024-01-31 09:51:34 -05:00
Vladimir Mandic 79eef747b3 unblock controlnet 2024-01-29 10:59:16 -05:00
brknsoul 2d32add1a0 Update shared.py 
Changing Settings Category from "Control" to "Control Options"
(tooltip conflict resolution)
 2024-01-29 07:52:22 -05:00
brknsoul 6d2924f713 Update shared.py 
Changing settings category name from "User Interface" to "User Interface Options"
 2024-01-29 07:52:22 -05:00
Vladimir Mandic 1fe544a053 improve control enums 2024-01-28 10:36:14 -05:00
Vladimir Mandic 7e447222a1 refactor api 2024-01-28 10:13:09 -05:00
Vladimir Mandic ebdc2144a8 add embedding convert notes 2024-01-27 15:39:54 -05:00
AI-Casanova 5c78268e28 Add Auto-conversion of SD 1.5 Embeddings to SDXL 2024-01-27 15:24:16 -05:00
Disty0 426aed55bc Cleanup 2024-01-27 17:45:31 +03:00
Vladimir Mandic 640b8279bf add hf token to settings 2024-01-27 09:28:53 -05:00
Vladimir Mandic 8fd081ad06 add SD_CONFIG_DEBUG 2024-01-25 12:37:08 -05:00
Disty0 db6fd95351 OpenVINO Quantization support with NNCF 2024-01-25 20:22:57 +03:00
Vladimir Mandic 7aa6876759 refactor all control processors to support unload and offload 2024-01-25 11:45:47 -05:00
Vladimir Mandic 06081f62c7 fix img2img with non-standard aspect ratio 2024-01-25 08:20:01 -05:00
Vladimir Mandic 7e88fe83e6 update install-sf 2024-01-24 09:40:26 -05:00
Vladimir Mandic 9ef930bca6 cleanup 2024-01-24 07:18:27 -05:00
Vladimir Mandic b15e13a11c opportunistic locking 2024-01-24 07:14:28 -05:00
Vladimir Mandic d9ffb12520 enable diffusers by default and disable move/offload by default 2024-01-21 11:18:17 -05:00
Vladimir Mandic 23a65de846 tweak theme and increse image sizes 2024-01-21 11:14:17 -05:00
Vladimir Mandic ddae9872a4 add simple-dark and simple-light themes 2024-01-21 09:37:45 -05:00
Vladimir Mandic 2c0b3ac4b3 add additional controlnets 2024-01-20 13:36:39 -05:00
Vladimir Mandic ced3b2e3a5 control add inpaint masked only 2024-01-20 11:34:22 -05:00
Vladimir Mandic 71654cee9c fix styles refresh 2024-01-20 07:48:20 -05:00
Vladimir Mandic 952edd29b2 remove custom gr components 2024-01-20 07:43:16 -05:00
Vladimir Mandic c7c9a82e07 add option to load model direct to gpu 2024-01-18 12:04:20 -05:00
Vladimir Mandic c887ae6fa7 reduce default font size 2024-01-17 10:02:55 -05:00
NetroScript 548d55bd6f Extra Network Search: Add special syntax: `|`, `-`, `r#` 2024-01-17 09:04:01 -05:00
NetroScript 4d93a78c10 Improve Extra Networks Search, by optionally allowing regex search 2024-01-17 09:04:01 -05:00
Vladimir Mandic 560e5a86e3 handle en tags with same names as en itself 2024-01-13 08:44:30 -05:00
Disty0 d4ca4acd7d Unify settings 2024-01-13 00:44:03 +03:00
Vladimir Mandic 011bac41df jumbo commit see changelog for details 2024-01-12 15:00:02 -05:00
Vladimir Mandic 8b2e06147f add disable_accelerate option 2024-01-11 13:39:44 -05:00
Vladimir Mandic ddef248594 add img2img_extra_noise for backend original 2024-01-11 08:04:10 -05:00
Disty0 d0b44a29b8 Cleanup OpenVINO and NNCF 2024-01-11 14:48:09 +03:00
Vladimir Mandic 204853afea global crlf to lf 2024-01-10 09:45:26 -05:00
Disty0 3352be21a6 NNCF compress Text Encoder and Lora support 2024-01-10 02:10:52 +03:00
Vladimir Mandic 23a4e6ee06 cleanup server settings 2024-01-09 14:51:21 -05:00
Vladimir Mandic 9eb56919df simplify backend select/lookups 2024-01-09 09:49:17 -05:00
Vladimir Mandic c55bdffe02 reduce imports and do not load ldm in diffusers 2024-01-08 12:11:38 -05:00
Vladimir Mandic 119424399f controle module enable scripts and extensions 2024-01-07 17:55:00 -05:00
Vladimir Mandic 13b295f525 enable global font size config via ui 2024-01-07 17:55:00 -05:00
Vladimir Mandic de80b74c64 uniform listdir and use threadpool to index loras 2024-01-06 15:15:23 -05:00
Disty0 f3cebcb9dd OpenVINO add experimental support for Text Encoder compiling 2024-01-06 01:37:04 +03:00
Vladimir Mandic 9fe8a827b2 refactor modeldata 2024-01-05 12:00:22 -05:00
Vladimir Mandic 025a60bede control add latent upscale 2024-01-05 09:26:14 -05:00
Disty0 6522c03667 OpenVINO 4 bit support for CPUs 2024-01-05 11:54:46 +03:00
Vladimir Mandic 9a96477111 optimize json parsing and extension register 2024-01-04 12:17:33 -05:00
Vladimir Mandic 7ef6efd41c fully modularize ui.py 2024-01-03 16:28:10 -05:00
Vladimir Mandic 17b30a320e enable batched taesd 2024-01-03 10:38:30 -05:00
Vladimir Mandic f7cd47d96f add fused projections 2024-01-02 09:41:15 -05:00
Vladimir Mandic 70bfe4ced8 enable gc on ram threshold 2023-12-31 08:15:22 -05:00
Vladimir Mandic c94d8ee4f2 hypertile autodetect optimal value 2023-12-30 13:59:22 -05:00
Vladimir Mandic 84ab19b8a5 separate control output folder 2023-12-30 13:59:22 -05:00
Disty0 b10a579421 IPEX 8 bit support with NNCF 2023-12-29 12:26:00 +03:00
Vladimir Mandic 1de3c6af0f add amused model support and update reference list 2023-12-27 10:15:36 -05:00
Vladimir Mandic 0c38745ffa fix atomic write 2023-12-25 18:07:37 -05:00
Vladimir Mandic 068809719a update requirements and add control-lllite 2023-12-25 14:45:01 -05:00
Disty0 843340d3b3 OpenVINO 8 bit support for CPUs 2023-12-23 15:30:33 +03:00
Vladimir Mandic ec0a08c4db fix inpaint overlay 2023-12-22 07:34:14 -05:00
Vladimir Mandic 9c8be9837b minor updates 2023-12-19 14:02:53 -05:00
Vladimir Mandic d872c8e569 add glora 2023-12-17 17:30:34 -05:00
Vladimir Mandic 0609e995bf add upscaler refresh 2023-12-16 18:38:27 -05:00
Vladimir Mandic 936cf9786c create_ui and process refactor 2023-12-15 18:54:48 -05:00
Vladimir Mandic b96fbd8f95 add img2img_apply_overlay 2023-12-14 10:09:55 -05:00
Vladimir Mandic 033569cfb1 minor updates 2023-12-12 14:36:00 -05:00
Disty0 ac85b3a423 Add OpenVINO cache path option to System Paths 2023-12-11 19:18:30 +03:00
Vladimir Mandic 4823595dc9 minor fixes 2023-12-10 10:27:44 -05:00
Vladimir Mandic f49e66577a lint fixes 2023-12-08 12:27:00 -05:00
Disty0 dc56ea140a Update shared opts 2023-12-08 19:10:08 +03:00
Vladimir Mandic 66f7a9af82 add lora_force_diffusers and lora_fuse_diffusers 2023-12-08 10:43:50 -05:00
Vladimir Mandic bd64bac2a3 update ip-adapter, schedulers and xyz-grid 2023-12-07 12:41:11 -05:00
Vladimir Mandic 71743dfda3 add playground models 2023-12-06 10:48:42 -05:00
Vladimir Mandic 2b49dae74f en load improvements, torchvision compatibility fix 2023-12-04 18:32:52 -05:00
Vladimir Mandic 439542d3df redesign profiler 2023-12-03 11:27:24 -05:00
Vladimir Mandic 84d733f0a0 add stable-video-diffusion 2023-11-30 11:21:26 -05:00
Vladimir Mandic d8d8f58072 initial lightweight animatediff 2023-11-28 19:30:10 -05:00
Vladimir Mandic 49f8730814 fix save text file for manually saved images 2023-11-27 08:07:12 -05:00
Vladimir Mandic 9edfc987e0 add task_args 2023-11-24 08:32:06 -05:00
Vladimir Mandic fd9d747a47 force inpaint 2023-11-22 12:28:35 -05:00
Disty0 bd141bbfeb IPEX decrease Torch GC Threshold to 80 2023-11-21 16:47:35 +03:00
Vladimir Mandic 606e4d5c08 configurable hf cache 2023-11-18 08:46:59 -05:00
Vladimir Mandic d46dddd024 fix upscale and add some compile options 2023-11-17 16:59:33 -05:00
Vladimir Mandic 53691c993e xyz formatting 2023-11-16 15:52:33 -05:00
Vladimir Mandic 12cf688cbe authentication and locking improvements 2023-11-16 15:26:36 -05:00
Disty0 d7410655cf Cleanup 2023-11-16 00:19:32 +03:00
Disty0 247a30a42c OpenVINO disable model caching 2023-11-15 23:45:53 +03:00
Vladimir Mandic 882da270e9 add SD_LORA_DIFFUSERS 2023-11-13 18:42:02 -05:00
Disty0 7d6ace5a4c Disable precompile for OpenVINO 2023-11-13 20:29:49 +03:00
Vladimir Mandic a0b8bcf63b refactor model compile and add stable-fast 2023-11-13 12:25:45 -05:00
Vladimir Mandic f1862579fd cleanup compile 2023-11-13 09:27:57 -05:00
Vladimir Mandic 8432e68d30 add extra networks list view 2023-11-03 13:55:40 -04:00
Disty0 996344c6f7 OpenVINO support for ESRGAN Upscaler and Torch 2.1 2023-11-03 14:24:13 +03:00
Vladimir Mandic 676ac120f1 log cleanup 2023-10-31 12:34:35 -04:00
Vladimir Mandic 96a138fe3c handle k-diffusion module 2023-10-31 11:42:32 -04:00
Vladimir Mandic cc7ad5e8de cleanup 2023-10-31 10:39:32 -04:00
Vladimir Mandic 76dc94010f enable taesd for lcm 2023-10-31 10:04:09 -04:00
Vladimir Mandic 8734445ae9 add models-dir to settings and simplify path improts 2023-10-30 08:31:42 -04:00
Vladimir Mandic 05a250cbf7 update 2023-10-29 11:22:26 -04:00
Seunghoon Lee db58f1f2ba
add prefix for directml specific option 2023-10-28 14:24:33 +09:00
Vladimir Mandic 267905e6bb Revert "Merge pull request #2411 from vladmandic/master" 
This reverts commit 64cce8a606, reversing
changes made to 597fc1863f.
 2023-10-26 07:30:01 -04:00
Vladimir Mandic 5219daa7fb Revert "Merge branch 'dev' into master" 
This reverts commit 4b91ee0044, reversing
changes made to fc7e3c5721.
 2023-10-26 07:17:40 -04:00
Vladimir Mandic 2522bdeedb redesign job state and progress bar 2023-10-24 22:02:46 -04:00
Vladimir Mandic 11834888c4 fix v_preditction 2023-10-24 14:12:02 -04:00
Disty0 dbd0bf4bac Add custom pipeline support for Diffusers backend 2023-10-24 20:12:40 +03:00
Seunghoon Lee 07a0d081e5
nan catch as an option 2023-10-22 18:39:27 +09:00
Disty0 0c70e6e595 Add compile support for upscalers 2023-10-22 00:29:37 +03:00
Vladimir Mandic df7c04ab27 add keep-interrupted option 2023-10-20 11:51:47 -04:00
Disty0 7b63e4c911 OpenVINO replace MULTI device with HETERO 2023-10-20 18:28:13 +03:00
Vladimir Mandic 3794af95c5 add a1111 compatibility items 2023-10-20 08:19:37 -04:00
Vladimir Mandic 6bda4fbc71 use short model name and update hints 2023-10-19 11:43:29 -04:00
Vladimir Mandic 231ca1ac7e fixes for zero-day issues 2023-10-18 11:37:33 -04:00
Vladimir Mandic cb2efb120a safe mode disable built-in 3rd party extensions 2023-10-17 09:35:16 -04:00
Vladimir Mandic c77bd7dcef a1111 compatibility items 2023-10-17 09:22:40 -04:00