1580158
/
automatic
mirror of https://github.com/vladmandic/automatic
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,799 Commits
3 Branches
29 Tags
109 MiB
Commit Graph

232 Commits (cfcfa4e4d28dcce91eb029c8a70d01042161403f)

Author SHA1 Message Date
Vladimir Mandic 09d1f1e788 add sa solver and prototype instaflow 2024-01-31 09:51:34 -05:00
Vladimir Mandic 3f8fa36a0c fix en display 2024-01-21 08:49:04 -05:00
Vladimir Mandic f6ac307a4e expand use of no-metadata 2024-01-19 20:23:01 -05:00
Vladimir Mandic 7c8d035edb better en preview matching and optimize caching 2024-01-19 13:50:23 -05:00
Vladimir Mandic f10a478c82 fix find preview 2024-01-17 11:44:52 -05:00
Midcoastal 94270243b4
Merge branch 'dev' into Dev/DirectoryCacheing 2024-01-14 19:54:50 -05:00
Midcoastal 86212a52d6
Cleanup, Ruff, Pylint 2024-01-14 18:49:07 -05:00
Vladimir Mandic 011bac41df jumbo commit see changelog for details 2024-01-12 15:00:02 -05:00
Vladimir Mandic 204853afea global crlf to lf 2024-01-10 09:45:26 -05:00
Vladimir Mandic de80b74c64 uniform listdir and use threadpool to index loras 2024-01-06 15:15:23 -05:00
Midcoastal cd18d29511
In-Memory Directory/File Cache 2024-01-05 16:55:01 -05:00
Vladimir Mandic 9a96477111 optimize json parsing and extension register 2024-01-04 12:17:33 -05:00
Vladimir Mandic 0df94404c4 add reference to original, reimplement control-xs 2023-12-27 08:52:04 -05:00
Vladimir Mandic 5cfc044ec6 tracing and control improvements 2023-12-20 17:33:19 -05:00
Vladimir Mandic 8ceeee8b87 add trace logging 2023-12-20 10:17:39 -05:00
Vladimir Mandic 2b56e82f16 modularize en 2023-12-17 09:32:26 -05:00
Vladimir Mandic 9e9d31f1b7 fix save params.txt 2023-12-13 08:34:42 -05:00
Vladimir Mandic 2b49dae74f en load improvements, torchvision compatibility fix 2023-12-04 18:32:52 -05:00
Vladimir Mandic 439542d3df redesign profiler 2023-12-03 11:27:24 -05:00
Vladimir Mandic 15503a7e0c add experimental model update 2023-11-21 12:25:19 -05:00
Vladimir Mandic b647fb84e9 fix non-sd pipeline 2023-11-18 11:20:31 -05:00
Vladimir Mandic 606e4d5c08 configurable hf cache 2023-11-18 08:46:59 -05:00
Vladimir Mandic 1de913f984 auto refresh styles on change 2023-11-14 17:16:33 -05:00
Vladimir Mandic d6aefd046c reference match previews 2023-11-13 16:20:21 -05:00
Vladimir Mandic 7cbd2bc9b5 fix list view 2023-11-09 09:28:44 -05:00
Vladimir Mandic f6dd495eb3 multiple fixes 2023-11-09 09:04:50 -05:00
Vladimir Mandic af30c1e27c en error handler 2023-11-07 13:15:45 -05:00
Vladimir Mandic e53db4e259 use ThreadPoolExecutor for extra networks 2023-11-07 08:00:44 -05:00
Vladimir Mandic 28ee8b4d57 improve preview lookups 2023-11-06 12:19:52 -05:00
Vladimir Mandic cca69e526d update 2023-11-06 09:42:09 -05:00
Vladimir Mandic d878970873 add reference models 2023-11-05 11:07:39 -05:00
Vladimir Mandic 2919774c01 improve en display 2023-11-05 08:09:40 -05:00
Vladimir Mandic 6e05fa865a improve en performance 2023-11-04 12:58:45 -04:00
Vladimir Mandic 8432e68d30 add extra networks list view 2023-11-03 13:55:40 -04:00
Vladimir Mandic da3d5d0fc7 context menus 2023-11-03 11:41:46 -04:00
Vladimir Mandic 676ac120f1 log cleanup 2023-10-31 12:34:35 -04:00
Vladimir Mandic 19203aab6c en add sort and other updates 2023-10-29 10:29:50 -04:00
Vladimir Mandic 53d0cb35b8 cleanup 2023-10-19 13:43:41 -04:00
Vladimir Mandic e0c92b1085 fix samplers 2023-10-19 10:19:46 -04:00
Vladimir Mandic 8aa2d0347c premerge fixes 2023-10-17 08:01:35 -04:00
Vladimir Mandic 24a8699890 fixed 2023-10-12 12:47:33 -04:00
Vladimir Mandic 1bc7ffed73 lint fixes 2023-10-12 11:40:50 -04:00
Vladimir Mandic b225cedb50 css tweaks 2023-10-06 08:33:12 -04:00
Vladimir Mandic 3727bf3d02 new lora handler and remove lyco 2023-10-05 14:30:58 -04:00
Vladimir Mandic 1369c4d714 initial built-in styles 2023-10-04 16:06:02 -04:00
Vladimir Mandic 1e70a1ae57 civitai multithreaded downloads 2023-10-03 10:46:00 -04:00
Vladimir Mandic bf3bb91d56 avoid js double load 2023-10-02 11:39:12 -04:00
Vladimir Mandic 1e66ff4f99 cleanup gradio 2023-10-02 08:57:43 -04:00
Vladimir Mandic 9d335a34e8 update en paths 2023-10-01 16:20:27 -04:00
Vladimir Mandic 1c28757061 update train script 2023-10-01 13:59:13 -04:00
Vladimir Mandic 4c98b8d1c7 minor patches and nvml cli 2023-09-30 17:17:57 -04:00
Vladimir Mandic 9cbe496d68 en load refiner, track server job state 2023-09-29 11:01:26 -04:00
Vladimir Mandic a2b00f34ec add vae to en 2023-09-29 09:00:44 -04:00
Vladimir Mandic a785f3da2e update main ui 2023-09-28 14:33:20 -04:00
Vladimir Mandic 23593d5442 en styles phase two 2023-09-28 14:33:20 -04:00
Vladimir Mandic 75c41498dd styles editing phase one 2023-09-26 19:11:51 -04:00
Vladimir Mandic 7d5119a5d7 add model metadata 2023-09-24 17:52:21 -04:00
Vladimir Mandic aabad68872 en details 2023-09-24 12:21:36 -04:00
Vladimir Mandic 940b4122f9 add en details view - phase one 2023-09-23 17:49:31 -04:00
Vladimir Mandic 36324361bd refactor en folder handling 2023-09-21 11:58:24 -04:00
Vladimir Mandic 0f3dc232c1 add en show/hide/reorder 2023-09-18 10:27:31 -04:00
Vladimir Mandic eee6d3104e rename en 2023-09-18 09:25:25 -04:00
Vladimir Mandic f4492f4c86 optimize en search 2023-09-17 10:47:25 -04:00
Vladimir Mandic 7bda411738 improve styles, better logging 2023-09-09 13:47:46 -04:00
Vladimir Mandic f36c1eb476 jumbo patch 2023-09-08 13:01:20 -04:00
Vladimir Mandic a6dcb8c2f5 fix en refresh 2023-09-07 16:15:42 -04:00
Vladimir Mandic 09b4c79f4a add job info to all jobs 2023-09-07 10:40:07 -04:00
Vladimir Mandic 81ff379e2c fix refiner 2023-09-07 09:38:35 -04:00
Vladimir Mandic 241b47fa72 fix en description style 2023-09-07 09:22:43 -04:00
Vladimir Mandic ac267d7f3f add light theme, enhance profilng and logging 2023-09-06 13:23:14 -04:00
Vladimir Mandic 4753f363d4 en refresh page 2023-09-05 12:36:08 -04:00
Vladimir Mandic a3033dc65f sort out embeddings loading in dffusers 2023-09-05 12:36:08 -04:00
Vladimir Mandic e9055c7cd8 major refactor 2023-09-04 11:31:29 -04:00
Vladimir Mandic d41baddf50 add styles to extra networks 2023-09-03 15:00:48 -04:00
Vladimir Mandic f32fcb5d16 cleanup 2023-09-01 13:47:33 -04:00
Vladimir Mandic 1b2890d02c extra network tags 2023-09-01 11:51:22 -04:00
Vladimir Mandic 9d4194edc2 read model metadata 2023-08-31 09:05:38 -04:00
Vladimir Mandic 10f345f09b handle loading invalid model or pipeline 2023-08-29 15:59:57 -04:00
Vladimir Mandic 9e2e2b8b8f fix gallery, update js logging, add en caching 2023-08-29 14:16:37 -04:00
Vladimir Mandic 91406bc9a0 update civit downloader 2023-08-26 14:13:56 +00:00
Vladimir Mandic 6a4d4ea5b7 update logging and model hashinh 2023-08-22 18:28:09 +00:00
Vladimir Mandic 53dcf157fb switch abs to relative paths 2023-08-21 08:11:30 +00:00
Vladimir Mandic 5eac99d3f5 optimize diffusers memory handling 2023-08-18 20:41:34 +00:00
Midcoastal 67f369ed25
A walk() optimization and lint fixes 2023-08-17 16:49:42 -04:00
Midcoastal 03363ce866
Resolve Lint Errors: C416 (x2), W291 and F541 2023-08-15 23:20:00 -04:00
Midcoastal c9bdd0344d
Allow JPEG image files 
JPEG is allowed and searched for when looking for previews/thumbs, and therefore should be allowed to view.
 2023-08-15 23:10:30 -04:00
Midcoastal 6eae768fb0
Gather HTML parts as list to append in the end 
Somehow, significant increase in speed (size of text append was slowing large loads down.
 2023-08-15 23:08:26 -04:00
Midcoastal 7e4aed7948
Add a FS directory/path cacher 
- Added FS dir/path mechanism to 'modules.modelloader'
- Refactored 'modules.modelloader.load_models' to use the cache
- Refactored 'modules.ui_extra_networks.find_*' methods to use the cache
- Added progress indicator to 'modules.ui_extra_networks.create_html'

The cache, as implimented, will always ensure it is up-to-date (per 'directory_has_changed') and significantly improves loading speed (when used with 'model_loader' and the 'find_*' methods) with large model directories.

Overall load speed tested with ~10k models (mix of checkpoints, loras, lycoris, and embeddings) and ~40k secndary files (images, descriptions, CivitAI Info, etc).  Loading speeds went from ~1 hour and 45 minutes to ~5 minutes.

Confounding variable to loading speeds: this is over a fiber-attached storage device.  Connection is 10gbe full-duplex, remote source has an NVMe raid cache.  Saturation of the network is the norm, but laintency is a factor.  Regardless, small-scale local-storage testing also shows measurable improvements, so this should be a welcome addition.
 2023-08-15 16:07:41 -04:00
Aptronymist 196fa29ee0 Update ui_extra_networks.py 
Added fix to thumbnail images that exceed 70kb to address slowdowns and wasted memory.
 2023-08-08 11:43:38 -04:00
Vladimir Mandic 58bfb9246f update lora enum 2023-07-26 19:27:38 -04:00
Vladimir Mandic c5b089cbb6 major ui simplification 2023-07-26 11:39:58 -04:00
Vladimir Mandic 02fe616141 fix en tags 2023-07-25 17:40:09 -04:00
Vladimir Mandic b31fa98669 fixes... 2023-07-21 09:28:02 -04:00
Vladimir Mandic a3ab302f51 fix extensions reset 2023-07-20 09:52:21 -04:00
Vladimir Mandic 19d176ea3d en add tags 2023-07-19 10:33:23 -04:00
Vladimir Mandic 42cba64ac8 add basename to info search 2023-07-14 08:58:05 -04:00
Vladimir Mandic 6b26c55138 fix extra network tab detection and add heic to training options 2023-07-11 08:35:18 -04:00
Vladimir Mandic 72048f9e24 installer and extra networks tweaks 2023-07-10 08:19:33 -04:00
Vladimir Mandic a16eee1504 bugfix release 2023-07-09 10:06:47 -04:00
Vladimir Mandic 0f4f8c6015 extra networks fixes 2023-07-07 20:20:48 -04:00