1580158
/
automatic
mirror of https://github.com/vladmandic/automatic
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,010 Commits
3 Branches
29 Tags
109 MiB
Commit Graph

75 Commits (6d6bb9d54b24d52b68259468cf05aae82f9abd8a)

Author SHA1 Message Date
Vladimir Mandic 1e70a1ae57 civitai multithreaded downloads 2023-10-03 10:46:00 -04:00
Vladimir Mandic d01f01c981 update upscalers 2023-09-30 09:20:25 -04:00
Vladimir Mandic 7f9013533d better error handling 2023-09-26 12:30:45 -04:00
Vladimir Mandic 38402c8e6e fix new k-diffusers 2023-09-26 09:55:22 -04:00
Vladimir Mandic ff28ac35e0 add actual latent upscalers 2023-09-25 19:46:12 -04:00
Vladimir Mandic 7d5119a5d7 add model metadata 2023-09-24 17:52:21 -04:00
Vladimir Mandic b00c323c31 update changelog 2023-09-21 07:52:09 -04:00
Vladimir Mandic 8ca79ad9b5 refactor upscalers 2023-09-20 13:07:29 -04:00
Vladimir Mandic fc75b5ec41 add wuerstchen model 2023-09-14 11:51:09 -04:00
Vladimir Mandic a1120666d8 fix styles and console logging 2023-09-13 16:50:03 -04:00
Vladimir Mandic 56e041c3b6 improve civitai integration 2023-09-10 18:13:20 -04:00
Vladimir Mandic 5a649f951a skip invalid diffusers model 2023-09-10 15:19:39 -04:00
Vladimir Mandic 250d1bf2fb update hints 2023-09-10 13:05:31 -04:00
Vladimir Mandic 7bda411738 improve styles, better logging 2023-09-09 13:47:46 -04:00
Vladimir Mandic 2187735187 hf quick model scan 2023-09-07 16:54:03 -04:00
Vladimir Mandic 09b4c79f4a add job info to all jobs 2023-09-07 10:40:07 -04:00
Vladimir Mandic 241b47fa72 fix en description style 2023-09-07 09:22:43 -04:00
Vladimir Mandic e9055c7cd8 major refactor 2023-09-04 11:31:29 -04:00
Vladimir Mandic d6f7bb92da add model preview download 2023-08-30 12:51:12 -04:00
Vladimir Mandic 91406bc9a0 update civit downloader 2023-08-26 14:13:56 +00:00
Vladimir Mandic 6a4d4ea5b7 update logging and model hashinh 2023-08-22 18:28:09 +00:00
Vladimir Mandic 53dcf157fb switch abs to relative paths 2023-08-21 08:11:30 +00:00
Vladimir Mandic 5eac99d3f5 optimize diffusers memory handling 2023-08-18 20:41:34 +00:00
Vladimir Mandic 20ba9aa649 update lint 2023-08-15 08:29:04 +02:00
Midcoastal 67f369ed25
A walk() optimization and lint fixes 2023-08-17 16:49:42 -04:00
Midcoastal 89da66207a
I guess I didn't quite understand Lint error C416 
Seems like a rather pedantic check, if you ask me...  Oh well.
 2023-08-16 00:25:27 -04:00
Midcoastal 03363ce866
Resolve Lint Errors: C416 (x2), W291 and F541 2023-08-15 23:20:00 -04:00
Midcoastal 873e864640
Ooof, modelloader changes needed for TI upgrade 2023-08-15 23:09:24 -04:00
Midcoastal 7e4aed7948
Add a FS directory/path cacher 
- Added FS dir/path mechanism to 'modules.modelloader'
- Refactored 'modules.modelloader.load_models' to use the cache
- Refactored 'modules.ui_extra_networks.find_*' methods to use the cache
- Added progress indicator to 'modules.ui_extra_networks.create_html'

The cache, as implimented, will always ensure it is up-to-date (per 'directory_has_changed') and significantly improves loading speed (when used with 'model_loader' and the 'find_*' methods) with large model directories.

Overall load speed tested with ~10k models (mix of checkpoints, loras, lycoris, and embeddings) and ~40k secndary files (images, descriptions, CivitAI Info, etc).  Loading speeds went from ~1 hour and 45 minutes to ~5 minutes.

Confounding variable to loading speeds: this is over a fiber-attached storage device.  Connection is 10gbe full-duplex, remote source has an NVMe raid cache.  Saturation of the network is the norm, but laintency is a factor.  Regardless, small-scale local-storage testing also shows measurable improvements, so this should be a welcome addition.
 2023-08-15 16:07:41 -04:00
Vladimir Mandic 5d5f22e6e1 remove invalid downloaded files 2023-08-12 08:07:13 +00:00
Vladimir Mandic a77fa4c12e add job info 2023-08-09 08:42:26 +00:00
Vladimir Mandic a5f95f4b38 civitai model search and download 2023-08-09 08:01:37 +00:00
Patrick von Platen a9d239ab51 [Diffusers] Make all Kandinsky work 2023-07-25 21:47:49 +00:00
Vladimir Mandic 46709ee391 fix image metadata and diffuser search 2023-07-18 20:41:47 -04:00
Vladimir Mandic debec28be6 rework settings, image-watermark, safe config handling 2023-07-18 14:41:27 -04:00
Vladimir Mandic a7f5e75a35 fix secondary model location 2023-07-15 16:07:10 -04:00
Vladimir Mandic a16eee1504 bugfix release 2023-07-09 10:06:47 -04:00
Vladimir Mandic 89a7ea6a3f overal quality fixes 2023-07-08 09:49:41 -04:00
Vladimir Mandic 8241e33868 major diffusers update 2023-07-03 16:48:03 -04:00
Vladimir Mandic cc685a8729 wip diffusers 2023-07-02 21:07:26 -04:00
Vladimir Mandic a2caafe4df initial diffusers merge into dev 2023-07-02 14:04:54 -04:00
Vladimir Mandic 0ddf613b49 jumbo merge part two 2023-06-14 11:23:02 -04:00
Vladimir Mandic cb307399dd jumbo merge 2023-06-13 11:59:56 -04:00
Patrick von Platen 46d410687e Improve when loading from diffusers 2023-06-05 18:22:17 +00:00
Vladimir Mandic 851d129680 more diffusers work 2023-05-27 15:49:54 -04:00
Vladimir Mandic efd3810860 diffusers merge 2023-05-26 22:42:03 -04:00
Vladimir Mandic 6c66228cde fix models dir 2023-05-18 08:17:49 -04:00
Vladimir Mandic 0ccda9bc8b jumbo patch 2023-05-17 14:15:55 -04:00
Vladimir Mandic 176ac924af make tensorflow optional 2023-04-23 08:11:26 -04:00
Vladimir Mandic 8b1f26324b optional model loader and integrate image info 2023-04-17 15:31:43 -04:00