1580158
/
automatic
mirror of https://github.com/vladmandic/automatic
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,799 Commits
3 Branches
29 Tags
109 MiB
Commit Graph

1327 Commits (cfcfa4e4d28dcce91eb029c8a70d01042161403f)

Author SHA1 Message Date
Vladimir Mandic e7f0047d52 add granular vae tiling options 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-25 12:38:21 -05:00
Vladimir Mandic 7d663249e8 move postprocessing scripts to accordions 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-23 12:23:18 -05:00
Disty0 6d3d23bddd OpenVINO disable model caching by default 2024-12-23 00:16:34 +03:00
Vladimir Mandic 0803946c08 update changelog and cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-19 11:34:19 -05:00
Vladimir Mandic a7e0723dcf profiling 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-18 13:02:22 -05:00
Vladimir Mandic fd7fe8cea5 add torchao 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-17 13:29:36 -05:00
Vladimir Mandic b1f1864099 lint updates 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-15 13:12:35 -05:00
Vladimir Mandic 3e8dec9297 add freescale 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-15 12:40:54 -05:00
Vladimir Mandic e9f951b2c5 offload logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-11 14:20:01 -05:00
Vladimir Mandic c3b0c0a3bf add SD_NO_CACHE env variable 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-11 12:32:34 -05:00
Vladimir Mandic 9a588d9c91 update balanced offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-11 12:06:03 -05:00
Vladimir Mandic f4847f1b8a optimize balanced offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-10 15:49:20 -05:00
Vladimir Mandic beea969fd3 update lora 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-10 12:34:27 -05:00
Vladimir Mandic 944408e93b warn on quanto with offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-10 10:39:13 -05:00
Vladimir Mandic 042178fedb reorg settings 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-10 10:20:00 -05:00
Vladimir Mandic 1185950c4a yet another lora refactor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-09 13:40:19 -05:00
AI-Casanova 6c9101dfaf
lora low memory mode: switching requires manual model reload 2024-12-06 22:54:08 -06:00
Vladimir Mandic 2965045993 change offload and upcast defaults 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-05 07:58:55 -05:00
Vladimir Mandic cfafa2b271
Merge branch 'dev' into lora-refactor 2024-12-02 11:23:15 -05:00
Vladimir Mandic 4eac263055 add bdia sampler 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-02 11:21:39 -05:00
Vladimir Mandic 7e2034c4ff lora add fuse 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-02 10:51:41 -05:00
Disty0 82eb924486 Reduce balanced offload max gpu memory to 0.70 2024-12-02 00:29:01 +03:00
Vladimir Mandic 023b13b6cb balanced offload improvements 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-12-01 15:34:25 -05:00
Vladimir Mandic b7aff134a2 add low/high threshold to balanced offload 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-30 19:03:51 -05:00
Disty0 6ec93f2d46 Disable load lora gpu with medvram too 2024-11-30 17:04:35 +03:00
Disty0 63ba83d361 ZLUDA enable Dynamic attention by default 2024-11-30 01:15:49 +03:00
Vladimir Mandic 6aa7a4707e modules.lora full integration 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-29 09:39:38 -05:00
Vladimir Mandic d6c1487f9a
Merge branch 'dev' into lora-refactor 2024-11-29 07:50:55 -05:00
Vladimir Mandic b74166f9cb detailer add augment setting 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-29 07:18:07 -05:00
Vladimir Mandic 164ce252dc add sd35 controlnets 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-28 08:46:10 -05:00
Vladimir Mandic 00ebdf3476 fix api scripts callbacks 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-27 10:07:37 -05:00
AI-Casanova cb561fa486
Major lora refactor: works on my machine edition 2024-11-23 21:57:03 -06:00
Vladimir Mandic 62c53942e0 post release jumbo patch 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-22 12:55:18 -05:00
Vladimir Mandic c5b1fb36a5 relax settings validator 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-21 20:29:16 -05:00
Vladimir Mandic 96ae1ec019 set default flowmatch shift value 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-18 14:26:08 -05:00
Vladimir Mandic 59cd08f5da update docker and progress monitoring 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-16 10:49:08 -05:00
Vladimir Mandic 4110bc746b param validation 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-14 13:19:34 -05:00
Vladimir Mandic 8d50661291 add docker support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-13 17:28:04 -05:00
Vladimir Mandic adec80861b fix validation 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 13:20:01 -05:00
Vladimir Mandic e2c7c8cf2e refactor processing class 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:19:12 -05:00
Vladimir Mandic 0cf3283ac8 update docs 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:18:33 -05:00
Vladimir Mandic 66820edb63 update 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-12 11:02:34 -05:00
Vladimir Mandic 29f5202811
Merge branch 'dev' into refactor-prompt 2024-11-06 10:58:03 -05:00
Vladimir Mandic f2ae3c1599 optimize initial networks display 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-02 09:30:52 -04:00
Vladimir Mandic 2c43d52fac detailer min/max size as fractions of image size 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-11-01 10:11:27 -04:00
Vladimir Mandic 4473f538bd changelog management, move assets 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-31 10:37:42 -04:00
AI-Casanova f3442abc92
Prompt LRU Cache 2024-10-26 18:47:11 -05:00
Vladimir Mandic 6760632f38 major model load refactor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-26 13:22:29 -04:00
Vladimir Mandic dbb9ba0890 cuda memory limits 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-26 07:51:40 -04:00
Vladimir Mandic 1ad8ca1d58 change model selector 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-25 11:23:41 -04:00
Disty0 3acf6013f6 OpenVINO add accuracy option 2024-10-24 19:28:15 +03:00
Disty0 801ebdd080 Treat Zluda as a different backend and auto disable BF16 for Zluda and ROCm on RDNA1-2 2024-10-24 15:06:39 +03:00
Vladimir Mandic a95a394234 fix styles migration 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-23 06:38:24 -04:00
Vladimir Mandic e09423bc3f update settings 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-22 15:56:57 -04:00
Vladimir Mandic 1b329a6570 cleanup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-22 15:55:25 -04:00
Vladimir Mandic f191134aa6 support bnb quantization during load 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-22 15:43:09 -04:00
Vladimir Mandic 56ec09fac8 add detailer multi-class support 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-21 10:57:19 -04:00
Vladimir Mandic ae4591ac0b reimplement torchao quantization 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-18 09:34:04 -04:00
brknsoul 918174e307
Update shared.py 
added autolaunch option
 2024-10-18 13:42:07 +10:30
Vladimir Mandic d15f66619c add support for torch expandable segments 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-15 12:52:42 -04:00
Vladimir Mandic 9de22ebcc7 ensure lora is not first to use quans 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-13 08:47:33 -04:00
Disty0 9c05124c33 Add devices.has_xpu() 2024-10-13 15:13:38 +03:00
Disty0 011d9c3348 Move device backed initialization to shared.py 2024-10-13 14:56:28 +03:00
Vladimir Mandic 0c54c235cb add sageattention 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-12 15:43:34 -04:00
Vladimir Mandic 3e6f7850f8 cleanup config 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-12 14:20:19 -04:00
Vladimir Mandic 69d3a95b12 fix adetailer 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-10 06:41:58 -04:00
Vladimir Mandic 723ce74986 add linfusion 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-09 11:01:16 -04:00
Vladimir Mandic f17fbe096d fix corner-case model load on startup 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-09 08:36:52 -04:00
Vladimir Mandic a722ed30d9 fix face restore dependend extensions 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-08 13:11:34 -04:00
Vladimir Mandic 2e08a26d53 add latent history 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-08 09:23:16 -04:00
Vladimir Mandic a3a177277a history prototype 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-07 19:09:44 -04:00
Vladimir Mandic e1a522892a update modernui for detailer 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-07 10:15:58 -04:00
Vladimir Mandic 3bbcc33181 add detailer 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-07 09:32:56 -04:00
Vladimir Mandic 04a5071249 face-hires -> detailer refactor 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-06 11:23:33 -04:00
Vladimir Mandic 3cd584b35b fix en height 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-04 16:03:14 -04:00
Vladimir Mandic 176c5c5773 sampler options rewrite 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-03 09:38:38 -04:00
Vladimir Mandic 9a46d381cc cleanups 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-01 20:02:21 -04:00
Vladimir Mandic 046d588de2 add fix-te 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-10-01 12:12:10 -04:00
Vladimir Mandic ac58b21d06 update flux lora code 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-09-30 10:16:02 -04:00
Vladimir Mandic fce431b1bd
Merge branch 'dev' into flux-lora 2024-09-30 08:34:15 -04:00
Vladimir Mandic d0f94503b5 logging 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-09-29 20:32:02 -04:00
Vladimir Mandic 47755dce6b refactor devices 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-09-29 20:17:03 -04:00
AI-Casanova bd5ac8e048
Add option, fix diffusers keys 2024-09-29 15:56:53 -05:00
Vladimir Mandic fe94edf781 set default cuda dtype to auto 
Signed-off-by: Vladimir Mandic <mandic00@live.com>
 2024-09-29 14:16:14 -04:00
Vladimir Mandic e7e79c4870 add lora_load_gpu setting 2024-09-25 18:05:53 -04:00
Vladimir Mandic ddefb38030 cleanup lora detect 2024-09-22 19:50:57 -04:00
Vladimir Mandic 6919ca310a lint updates 2024-09-21 15:44:53 -04:00
Vladimir Mandic 419f34272f add gradio_skip_video setting 2024-09-21 08:39:36 -04:00
Vladimir Mandic 2acb883dda jumbo update, see changelog 2024-09-18 13:48:30 -04:00
Vladimir Mandic 55148445f7 lora auto-apply tags 2024-09-15 12:28:39 -04:00
Vladimir Mandic a6136a6eec disable offloading for backend=original 2024-09-14 10:38:51 -04:00
Vladimir Mandic c07e7c765d flag backend=original 2024-09-14 10:38:06 -04:00
Vladimir Mandic a92e1ce664 enable full resize opts in hires 2024-09-08 12:32:45 -04:00
Vladimir Mandic 605e5f67aa add context-aware image resize 2024-09-07 11:58:58 -04:00
AI-Casanova d1d0cdecb2
Implement seam-carving 2024-09-06 18:34:04 -05:00
Vladimir Mandic f2c5cbbb36 lint updates and diffusers installer 2024-09-06 14:10:53 -04:00
Vladimir Mandic b4df9a4de1 jumbo update with flux.1 refactor, see changelog for details 2024-09-01 22:56:15 -04:00
Vladimir Mandic 0d9ce663e4 post release dev merge, see changelog for details 2024-09-01 12:20:10 -04:00
Vladimir Mandic 9d142581b9 flux nf4 offline load 2024-08-31 11:46:41 -04:00
Vladimir Mandic a11a5f0562 flux qint auto-download quantization map 2024-08-31 07:51:08 -04:00
Vladimir Mandic ed52624bef
Merge branch 'dev' into xhinker 2024-08-28 08:11:52 -04:00
Vladimir Mandic 5ed58ac7cc end-to-end update flux, see changelog and wiki 2024-08-28 08:04:24 -04:00
AI-Casanova 517ee93e96
xhinker parser implementation 2024-08-25 18:23:45 -05:00
Disty0 2caf52a546 Update Quanto settings names 2024-08-21 19:25:38 +03:00
Disty0 16d6c03d45 Optimum Quanto activations support 2024-08-21 17:30:45 +03:00
Disty0 b025d1dab1 Round memory size in settings 2024-08-19 18:56:28 +03:00
Disty0 cc89ed84f9 Rename cpu offload to model offload 2024-08-19 18:48:09 +03:00
Disty0 2586a18218 Don't add 0.1 to the GPU memory 2024-08-18 13:18:24 +03:00
Disty0 a3f26c9df0 Convert Dynamic Attention SDP to a global SDP option 2024-08-18 01:44:27 +03:00
Disty0 bce3c7eabf Fix --Xvram flags not activating offload 2024-08-18 00:23:15 +03:00
Disty0 8699e0cacb Add gc to balanced offload 2024-08-14 17:37:07 +03:00
Disty0 8619a7f35c Better balanced offload 2024-08-14 11:53:35 +03:00
Disty0 0f7b7e83bc Fix memory detection when no gpu is present 2024-08-12 01:41:54 +03:00
Disty0 fb89e26b54 Auto detect memory size ffor balaced offload 2024-08-11 19:01:49 +03:00
Disty0 e3b087b6c0 Add balanced offload mode and make offload modes a single choice list 2024-08-11 17:27:30 +03:00
Disty0 dc9e60aa67 Quant add shuffle models option 2024-08-04 04:46:06 +03:00
Disty0 b50a8601fe Fix T5 INT8 and add QINT8 2024-07-30 18:23:21 +03:00
Disty0 6c75bcca0a Optimum Quanto support 2024-07-30 17:35:56 +03:00
Vladimir Mandic 6ad519e51f css 2024-06-22 20:16:32 -04:00
Vladimir Mandic e8165c3d63 xyz grid add lora selector 2024-06-22 18:40:06 -04:00
Vladimir Mandic 4e80e6c40c add option to disable text-encoder cache 2024-06-20 11:46:38 -04:00
Disty0 eb6e3c337c NNCF ControlNet support 2024-06-19 22:42:00 +03:00
Disty0 bf9565cb46 NNCF compression support on CPU and add INT8 option for T5 2024-06-19 21:23:47 +03:00
Vladimir Mandic 0de6be4621 fix save style without name 2024-06-17 11:03:24 -04:00
Vladimir Mandic bbaa03a466 add 4bit t5 2024-06-17 09:39:30 -04:00
Vladimir Mandic deefbe59a4 sd3 sampler shift support 2024-06-16 15:56:25 -04:00
Vladimir Mandic 26cff4557c handle fallback theme 2024-06-16 08:00:35 -04:00
Vladimir Mandic 6e01d510d4 add sd3 2024-06-12 21:02:48 -04:00
Disty0 5f41181576 Cascade normalize padding and replace empty embed option with zeros 2024-06-13 03:13:45 +03:00
Vladimir Mandic a20103a86c add prompt attention normalization 2024-06-10 15:48:55 -04:00
Disty0 4f482986d1 Add empty prompt padding option 2024-06-10 17:59:07 +03:00
Vladimir Mandic db9718eee6 add torch full deterministic mode 2024-06-07 09:26:51 -04:00
Vladimir Mandic 5574833f0d refactor backend detection 2024-06-06 20:41:10 -04:00
Vladimir Mandic e15c21ede9 facehires implement include mask in output 2024-06-04 07:56:46 -04:00
Vladimir Mandic 99bddca5c1 fix control prompt lists 2024-05-29 13:48:07 -04:00
Vladimir Mandic 9b08e720a5 better image save reporting 2024-05-17 10:10:52 -04:00
Vladimir Mandic d63f35e298 add cudaMallocAsync 2024-05-16 18:02:55 -04:00
Vladimir Mandic 8b8d91f3e4 update 2024-05-15 11:31:27 -04:00
Vladimir Mandic eb34241ca9 enhance metadata handling 2024-05-15 10:08:31 -04:00
Vladimir Mandic 76cbf11559 cache diffusers model config 2024-05-14 12:54:34 -04:00
Vladimir Mandic 6733f3437a move face restore settings 2024-05-14 11:34:51 -04:00
Vladimir Mandic 6d85980c56 face-hires improvements 2024-05-13 17:46:25 -04:00
Vladimir Mandic f958ca0c21 add wildcards 2024-05-12 11:53:25 -04:00
Vladimir Mandic 51f9c3a99b en default sort and disable hypernet by default 2024-05-12 08:52:34 -04:00
Disty0 66de7597d1 OpenVINO disable upscaler compile by default 2024-05-12 14:08:41 +03:00
Vladimir Mandic eff5dce05f new sampler features 2024-05-11 12:53:45 -04:00
Vladimir Mandic e7b30ef662 a1111 optioninfo compatibility 2024-05-10 08:46:38 -04:00
Vladimir Mandic a697366951 tunable force lora loading method 2024-05-06 20:20:59 -04:00
Vladimir Mandic c42fded960 add pag for sd15 and sdxl 2024-05-06 19:57:40 -04:00
Vladimir Mandic 9ff507d93a add todo token downsampling and simplify tomes 2024-04-28 20:29:28 -04:00