Commit Graph

103 Commits (2e75ce2610d4b6f0c2b4df54e2a9dce7d90788db)

Author SHA1 Message Date
Vladimir Mandic 91406bc9a0 update civit downloader 2023-08-26 14:13:56 +00:00
Vladimir Mandic 6a4d4ea5b7 update logging and model hashinh 2023-08-22 18:28:09 +00:00
Vladimir Mandic 53dcf157fb switch abs to relative paths 2023-08-21 08:11:30 +00:00
Vladimir Mandic 5eac99d3f5 optimize diffusers memory handling 2023-08-18 20:41:34 +00:00
Midcoastal 67f369ed25
A walk() optimization and lint fixes 2023-08-17 16:49:42 -04:00
Midcoastal 03363ce866
Resolve Lint Errors: C416 (x2), W291 and F541 2023-08-15 23:20:00 -04:00
Midcoastal c9bdd0344d
Allow JPEG image files
JPEG is allowed and searched for when looking for previews/thumbs, and therefore should be allowed to view.
2023-08-15 23:10:30 -04:00
Midcoastal 6eae768fb0
Gather HTML parts as list to append in the end
Somehow, significant increase in speed (size of text append was slowing large loads down.
2023-08-15 23:08:26 -04:00
Midcoastal 7e4aed7948
Add a FS directory/path cacher
- Added FS dir/path mechanism to 'modules.modelloader'
- Refactored 'modules.modelloader.load_models' to use the cache
- Refactored 'modules.ui_extra_networks.find_*' methods to use the cache
- Added progress indicator to 'modules.ui_extra_networks.create_html'

The cache, as implimented, will always ensure it is up-to-date (per 'directory_has_changed') and significantly improves loading speed (when used with 'model_loader' and the 'find_*' methods) with large model directories.

Overall load speed tested with ~10k models (mix of checkpoints, loras, lycoris, and embeddings) and ~40k secndary files (images, descriptions, CivitAI Info, etc).  Loading speeds went from ~1 hour and 45 minutes to ~5 minutes.

Confounding variable to loading speeds: this is over a fiber-attached storage device.  Connection is 10gbe full-duplex, remote source has an NVMe raid cache.  Saturation of the network is the norm, but laintency is a factor.  Regardless, small-scale local-storage testing also shows measurable improvements, so this should be a welcome addition.
2023-08-15 16:07:41 -04:00
Aptronymist 196fa29ee0 Update ui_extra_networks.py
Added fix to thumbnail images that exceed 70kb to address slowdowns and wasted memory.
2023-08-08 11:43:38 -04:00
Vladimir Mandic 58bfb9246f update lora enum 2023-07-26 19:27:38 -04:00
Vladimir Mandic c5b089cbb6 major ui simplification 2023-07-26 11:39:58 -04:00
Vladimir Mandic 02fe616141 fix en tags 2023-07-25 17:40:09 -04:00
Vladimir Mandic b31fa98669 fixes... 2023-07-21 09:28:02 -04:00
Vladimir Mandic a3ab302f51 fix extensions reset 2023-07-20 09:52:21 -04:00
Vladimir Mandic 19d176ea3d en add tags 2023-07-19 10:33:23 -04:00
Vladimir Mandic 42cba64ac8 add basename to info search 2023-07-14 08:58:05 -04:00
Vladimir Mandic 6b26c55138 fix extra network tab detection and add heic to training options 2023-07-11 08:35:18 -04:00
Vladimir Mandic 72048f9e24 installer and extra networks tweaks 2023-07-10 08:19:33 -04:00
Vladimir Mandic a16eee1504 bugfix release 2023-07-09 10:06:47 -04:00
Vladimir Mandic 0f4f8c6015 extra networks fixes 2023-07-07 20:20:48 -04:00
Vladimir Mandic 3e1a6a96d0 add additional pipelines 2023-07-07 09:38:19 -04:00
Vladimir Mandic 145b990c73 thumbnail creation exception handling 2023-07-03 22:47:29 -04:00
Vladimir Mandic 8241e33868 major diffusers update 2023-07-03 16:48:03 -04:00
Vladimir Mandic d61b0cfd4c update extra networks 2023-07-02 07:43:01 -04:00
Vladimir Mandic 8000d1965d new extra networks 2023-06-30 15:29:31 -04:00
Vladimir Mandic 05a9f5a892 create extra network thumbnails from previews 2023-06-28 14:55:42 -04:00
Vladimir Mandic c80b1ebc36 stricter lint rules 2023-06-27 10:28:47 -04:00
Vladimir Mandic 91e65fd3c5 sort extra networks depth-first 2023-06-22 09:36:42 -04:00
Vladimir Mandic 8d80b5f6d9 add server class 2023-06-17 13:44:55 -04:00
Vladimir Mandic 9334b2f21c jumbo merge part three 2023-06-14 13:54:23 -04:00
Vladimir Mandic 0ddf613b49 jumbo merge part two 2023-06-14 11:23:02 -04:00
Vladimir Mandic cb307399dd jumbo merge 2023-06-13 11:59:56 -04:00
Vladimir Mandic fff3bda6cf fix extra network save preview/description 2023-06-06 07:52:59 -04:00
Vladimir Mandic c49b6c34e1 fix extra networks 2023-06-05 15:14:50 -04:00
Vladimir Mandic c0a824d8c6 add extra networks to xyz 2023-06-05 10:32:08 -04:00
Vladimir Mandic b127ca4874 catch extra networks error 2023-06-04 07:05:31 -04:00
Vladimir Mandic c7051cc1dd extra error handling during image save 2023-06-03 09:05:01 -04:00
Vladimir Mandic 02c9640fa5 enhance image saving 2023-06-01 15:44:38 -04:00
Vladimir Mandic c1e70df845 follow symlinks 2023-05-18 07:36:38 -04:00
Vladimir Mandic 0ccda9bc8b jumbo patch 2023-05-17 14:15:55 -04:00
Vladimir Mandic 05656a54fe update extra networks 2023-05-11 09:30:34 -04:00
wbh1129 0055336894
ui_extra_networks.py: make description default to "" instead of error 2023-05-06 06:06:17 -05:00
Vladimir Mandic 7a083d322b merge commits 2023-05-02 15:06:06 -04:00
Vladimir Mandic 69ee51f7f2 fix extra networks 2023-04-29 14:16:39 -04:00
Vladimir Mandic 408147d9c4 critical fix 2023-04-29 13:25:20 -04:00
Vladimir Mandic 5dcaaba614 reduce extra network exceptions 2023-04-27 09:42:41 -04:00
Miao Xiang f7c7f396bb fix for vlad fork 2023-04-23 21:36:59 -07:00
Miao Xiang b1050a3dcb fix typo 2023-04-23 21:00:22 -07:00
Samuel 1cf6b91862 Use smaller ToolButton for 🔃 in extra networks submenu 2023-04-20 14:43:46 -04:00