Commit Graph

7327 Commits (10bbbed218458b8a899aac2140ec738d8d716f05)

Author SHA1 Message Date
Vladimir Mandic 45d5189b83 add privacy blur for tokens in ui
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-09 09:03:02 -04:00
Disty0 69db77e365 SDNQ remove eps 2025-08-09 02:39:01 +03:00
Disty0 22d86acda3 Make SDNQ MatMul listen to the dequantize fp32 setting 2025-08-09 01:10:07 +03:00
Vladimir Mandic 0cc24a6d81 lint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-08 18:09:46 -04:00
Vladimir Mandic 09cc584089 civitai downloader batch download all versions
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-08 18:06:36 -04:00
Vladimir Mandic 00e34ce0d3 cleanup reference models
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-08 14:07:33 -04:00
Vladimir Mandic 80f603f3ff fix sd35 width/height alignment
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-08 13:07:50 -04:00
Vladimir Mandic a345ae0e3b flux-kontext with variable resolution
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-08 11:44:21 -04:00
Vladimir Mandic 353d73e042 add chroma-v50 and chroma-v50-annealed
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-08 10:15:00 -04:00
Vladimir Mandic 9ef6baf2ed use `utf_16_be` as primary metadata decoding
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-08 07:36:11 -04:00
Vladimir Mandic c0b8c4e2cb update changelog
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-07 17:11:12 -04:00
Disty0 5ffb6e8b88 Cleanup 2025-08-07 23:36:38 +03:00
Disty0 3edb80e1be Add api/rocm_smi.py 2025-08-07 23:23:24 +03:00
Vladimir Mandic e111d151e5 lint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-07 14:19:43 -04:00
Vladimir Mandic 7e5e9eb8bb add basic vace support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-07 14:08:29 -04:00
Vladimir Mandic 5d9c0675e5 cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-07 13:56:13 -04:00
Vladimir Mandic 4b74fd26b5 redesign gpu monitor
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-07 13:56:13 -04:00
Vladimir Mandic 3e3adcee74 add skyreels-v2
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-07 13:56:13 -04:00
Disty0 31e6cfd91b Fix IPEX 2.8 2025-08-07 15:14:45 +03:00
Vladimir Mandic a9c65c0e8c move api-only to legacy options
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-06 19:27:57 -04:00
Vladimir Mandic a91ee36b5c fix settings components mismatch
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-06 18:35:43 -04:00
Disty0 aa0652caa9 SDNQ fix new transformers 2025-08-07 00:18:24 +03:00
Disty0 6207b6d841 Update ROCm and OpenVINO to Torch 2.8 2025-08-06 21:33:50 +03:00
Vladimir Mandic 6a6605191f configurable image fit in all image views
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-06 11:33:50 -04:00
Vladimir Mandic 7bba30e797 sdnq obey diffusers_to_gpu
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-06 10:12:27 -04:00
Disty0 ab8badfe0d SDNQ use non-blocking ops 2025-08-06 17:07:36 +03:00
Vladimir Mandic ba4bff08d6 remove ldsr and refactor sdnq device map
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-06 09:27:54 -04:00
Vladimir Mandic 31664864bf qwen cleanup and update changelog
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-06 08:54:56 -04:00
Vladimir Mandic e23ca199c0 networks indicator for active loras
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-06 07:25:28 -04:00
Vladimir Mandic 5fd44e473e fix networks scan
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-06 06:21:17 -04:00
Vladimir Mandic 11a6b1e14b rename size controls
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-05 13:35:50 -04:00
Vladimir Mandic 692c236831 modernui updates
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-05 13:28:55 -04:00
Vladimir Mandic c0de857b11 simlify extensions layout
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-05 09:21:40 -04:00
Vladimir Mandic 1d37a25495 add note on qwen blocker
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-04 15:53:43 -04:00
Vladimir Mandic 79db2f28d1 fix nunchaku download links for windows
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-04 15:53:43 -04:00
Vladimir Mandic 49e3ff163a lint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-04 15:53:43 -04:00
Vladimir Mandic fd842e275a add qwen-image
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-04 15:53:43 -04:00
Vladimir Mandic 8aff68fe06 new models tab including civitai downloader
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-04 15:53:43 -04:00
Vladimir Mandic 895c7f41fb gallery bypass thumb cache and safer delete ops
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-04 15:53:43 -04:00
Vladimir Mandic 66456f3b4f civitai search redesign prototype
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-04 15:53:43 -04:00
Disty0 2cdb15b1ce IPEX enable int_mm fallback for torch 2.8 2025-08-03 18:38:13 +03:00
Vladimir Mandic 84bccc07ca update simple-table
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-03 08:43:36 -04:00
Vladimir Mandic ea9d8b2323 lint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-02 19:27:07 -04:00
Vladimir Mandic 265cb5e8ba redo ui model metadata
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-02 18:46:40 -04:00
Vladimir Mandic e90ac68dcc lint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-02 15:28:45 -04:00
Vladimir Mandic 800521d885 update models current and list tabs
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-02 14:18:58 -04:00
Vladimir Mandic 4a953a7e8d new models-list_models
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-02 14:18:58 -04:00
Vladimir Mandic f9b585d983 refactor ui_models
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-02 14:18:58 -04:00
Disty0 1d5dce1fb1 cleanup 2025-08-02 17:41:53 +03:00
Disty0 c3d007b02c SDNQ split forward.py into layers and cleanup 2025-08-02 17:36:55 +03:00
Vladimir Mandic 5f384a9de7 video save frames
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-02 08:22:32 -04:00
Vladimir Mandic 461bed5720 experimental sampler monkeypatch
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-02 07:06:34 -04:00
Vladimir Mandic f7e433bd07 lint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-01 18:26:57 -04:00
Vladimir Mandic 9394430aa3 cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-01 16:46:27 -04:00
Disty0 61a5e5ebca Fix module size detection 2025-08-01 23:45:24 +03:00
Vladimir Mandic 4be093b80f add diffusers_offload_nonblocking setting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-01 16:38:31 -04:00
Disty0 52bef2871b Fix balanced offload pre forward with partial offload 2025-08-01 23:04:58 +03:00
Disty0 5809476e22 fix balanced offload pre_forward not offloading 2025-08-01 22:38:55 +03:00
Vladimir Mandic fe4aa958f8 fix seed in file namegen
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-01 14:56:44 -04:00
Vladimir Mandic fbad5d87d6 add offload pre-forward
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-01 10:49:03 -04:00
Vladimir Mandic b291c337a1 refactor internal post loop
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-08-01 10:45:39 -04:00
Vladimir Mandic 5a9b72ec57 add quicksettings reset button
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-31 19:39:20 -04:00
Vladimir Mandic b120778c4f lint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-31 17:33:44 -04:00
Vladimir Mandic 7167d9d82a api set default script-name
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-31 17:16:47 -04:00
Vladimir Mandic fa44521ea3 offload-never and offload-always per-module and new highvram profile
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-31 11:40:24 -04:00
Vladimir Mandic 1b3f5405a3 fix batch processing
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-31 09:56:40 -04:00
Vladimir Mandic a1fad27b0e embedded docs/wiki search
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-31 09:56:40 -04:00
Vladimir Mandic 43e30929ca fix ui wiki search
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-31 09:56:40 -04:00
Disty0 6a981358e7 Fix OpenVINO 2025-07-31 12:42:40 +03:00
Vladimir Mandic 052f097956 lint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-30 13:14:04 -04:00
Vladimir Mandic 76504e5264 add explicit BOS/EOS handling in prompt parser
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-30 12:46:01 -04:00
Vladimir Mandic f53ee29366 infotext apply styles and fix progress bar
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-30 12:02:47 -04:00
Vladimir Mandic d8e03bb855 improve handling of wan22 stages
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-30 11:22:08 -04:00
Vladimir Mandic c36e8efd38 add missing interrogate in output panel
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-30 09:14:59 -04:00
Vladimir Mandic e8fedf0a73 fix api progress reporting endpoint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-30 08:32:30 -04:00
Vladimir Mandic 473ea67fb4 fix processing image save loop
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-30 08:04:08 -04:00
Vladimir Mandic 77e0eecf58 fix inpaint image metadata
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-30 07:25:34 -04:00
Vladimir Mandic e980e39a35 fix token counter error state
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-29 14:43:24 -04:00
Vladimir Mandic 629e90814f cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-29 09:29:36 -04:00
Vladimir Mandic 8dae6d0c6d lint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-29 09:24:23 -04:00
Vladimir Mandic c07e5d74ab control auto-determine save path
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-29 09:07:36 -04:00
Vladimir Mandic 636d261159 fix networks tags display
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-29 06:47:22 -04:00
Vladimir Mandic 7dcc5b67f6 fix yolo model refresh
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-29 06:04:14 -04:00
Vladimir Mandic 7cbc59567a reduce taesd error reporting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-28 20:22:31 -04:00
Vladimir Mandic 74bb2b9ea6 autodetect v-pred
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-28 19:41:39 -04:00
Vladimir Mandic db9e2127c1 fix lora with hidiffusion blocks
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-28 16:25:22 -04:00
Vladimir Mandic 8ec16d5b8c update modernui
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-28 13:47:13 -04:00
Vladimir Mandic b34324eeb2 lora error logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-27 16:40:01 -04:00
Vladimir Mandic 8e40c5b0a9 add bigasp25 support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-27 16:32:37 -04:00
Disty0 f02cfeaef9 Rename SDNQ TE dtype default to Same as model 2025-07-27 23:06:41 +03:00
Vladimir Mandic a1ef13098b fix processing skip
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-27 10:27:58 -04:00
Vladimir Mandic fd722311db css and logging tweaks
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-27 08:17:41 -04:00
Vladimir Mandic ec547d60d1 cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-26 20:08:59 -04:00
Vladimir Mandic 04af23a3bc refactore pipeline apply/unapply optional components & features
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-26 20:04:07 -04:00
Vladimir Mandic b5a87c4828 modify installer checks
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-26 18:40:28 -04:00
Disty0 41b4e79280 IPEX add torch._int_mm fallback via onednn qlinear 2025-07-26 15:54:18 +03:00
Vladimir Mandic 896c3ce9c2 fix detailer min/max thresholds
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-26 08:41:12 -04:00
Disty0 c21c7e545a cleanup 2025-07-26 04:52:56 +03:00
Disty0 9afb122367 Fix prompt parser with Flux 2025-07-26 04:25:43 +03:00
Disty0 ad716b118b fix enable_gqa with dyn atten 2025-07-26 01:49:17 +03:00
Vladimir Mandic e8bec2823a css fonts update
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-25 14:55:24 -04:00
Vladimir Mandic a298173cf0 handle batch when saving images
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-25 13:13:32 -04:00
Vladimir Mandic b311bdf91e fix prompt encoding if prompts within batch have different segment counts
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-25 12:59:14 -04:00
Vladimir Mandic 0b8001c0fa prompt error handling
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-25 12:38:25 -04:00
Vladimir Mandic fd2dde9154 sorry
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-25 11:46:28 -04:00
Vladimir Mandic f90e8d7118 error handling
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-25 11:41:20 -04:00
Vladimir Mandic 97c537a9c2 fix metadata handler
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-25 08:35:01 -04:00
Vladimir Mandic 5179255ff7 lint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-24 17:42:13 -04:00
Vladimir Mandic 17fbc96a8c detect invokeai metadata
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-24 17:35:52 -04:00
Vladimir Mandic 2656d3aa68 lint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-24 15:42:29 -04:00
Vladimir Mandic fc0e0635b5 detailer add option to merge multiple results into composite mask
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-24 15:32:07 -04:00
Vladimir Mandic aed0086cb7 update styles and add simple gallery separator click option
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-24 12:48:03 -04:00
Vladimir Mandic 7365b2e632 unique ui labels
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-24 09:14:22 -04:00
Vladimir Mandic 32e1787b47 add bria-3.2 model support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-23 12:10:52 -04:00
Disty0 444974a6ff cleanup 2025-07-23 19:02:44 +03:00
Disty0 7a08e1a7f2 SDNQ always use custom tensorwise fp8 matmul 2025-07-23 19:01:10 +03:00
Vladimir Mandic 094647b373 fix missing ui components
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-23 08:38:12 -04:00
Vladimir Mandic bf6ba07478 update css and lint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-22 13:45:09 -04:00
Vladimir Mandic 143aa202e6 fix modernui txt2img sampler
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-22 13:21:31 -04:00
Vladimir Mandic 0602bedd13 fix modules merge
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-22 10:46:35 -04:00
Vladimir Mandic 41269b05c0 handle startup errors
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-22 10:19:30 -04:00
Vladimir Mandic 36c356785e modernui updates
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-22 10:07:17 -04:00
Vladimir Mandic 159a5c9fac linting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-21 19:24:20 -04:00
Vladimir Mandic f243c35892 improve traceback display
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-21 19:07:35 -04:00
Vladimir Mandic 0cc48bb429 improve details model parser
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-21 13:42:16 -04:00
Vladimir Mandic 23a4e6f97f cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-21 11:15:15 -04:00
Vladimir Mandic a852d1cea9 add detailer expert mode
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-21 10:39:19 -04:00
Vladimir Mandic 287c3600d7 torch compile for llm
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-20 12:07:30 -04:00
Vladimir Mandic ea0b84ffc0 group offloading (experimental)
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-20 09:33:02 -04:00
Disty0 25a4731a97 SDNQ use static compile 2025-07-20 16:25:57 +03:00
Vladimir Mandic 27ce0dea9a torch.compile use repeated blocks
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-20 08:44:25 -04:00
Vladimir Mandic 7d91f7e662 process batch warn and continue
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-20 07:33:42 -04:00
Vladimir Mandic 3bf31eb4fd linting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-19 11:33:16 -04:00
Vladimir Mandic 74d3f0bdd5 integrate nudenet
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-19 11:17:10 -04:00
Vladimir Mandic e576ea4319 cn always generate blended processed image
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-18 18:19:56 -04:00
Vladimir Mandic 1b36607bce restore pipeline before hires
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-18 17:55:45 -04:00
Vladimir Mandic 4ef0a4d5a1 fix styles logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-18 10:46:20 -04:00
Vladimir Mandic da90c0c7ff reduce memory leak on control unit change
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-18 09:50:36 -04:00
Vladimir Mandic ee57eb6b45 fix control handling of init images
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-18 07:31:59 -04:00
Vladimir Mandic efd86ef901 fix styles logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-18 07:13:05 -04:00
Vladimir Mandic b61118ffc8 detect comfyui metadata
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-17 09:02:23 -04:00
Vladimir Mandic 89ec1c09db improve git error logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-17 08:18:52 -04:00
Vladimir Mandic 54bdf011ed more linting and update diffusers
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-16 13:12:40 -04:00
Vladimir Mandic 17b8fcd902 lint fixes
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-16 12:59:40 -04:00
Vladimir Mandic 85fedbaf12 add styles debug
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-16 12:54:22 -04:00
Vladimir Mandic ed7e150051 fix control batch-input processing
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-16 12:45:29 -04:00
Vladimir Mandic e2a443c885 control xyz support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-16 12:07:43 -04:00
Vladimir Mandic 878fda65ab refactor control processing
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-16 11:04:48 -04:00
Vladimir Mandic cd84cfec11 xyzgrid with control tab
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-15 14:35:27 -04:00
Vladimir Mandic a77975165c fix xyz with control enabled
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-15 09:11:54 -04:00
Vladimir Mandic 251c919c51 auto-handle sampler flow detection
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-14 22:07:39 -04:00
Vladimir Mandic 935a4a0aa3 add wan 2.1 text-to-image
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-14 13:47:14 -04:00
Vladimir Mandic 79d0fb81af fix inpainting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-14 09:11:17 -04:00
Disty0 655c74da73 Add post load quant support to video 2025-07-14 16:01:13 +03:00
Vladimir Mandic 84df2f8ce6 force gc at processing end
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-14 08:59:42 -04:00
Vladimir Mandic 0f2f164245 add smollm3, add auraflow-0.2, enable taesd for auraflox
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-14 07:24:20 -04:00
Disty0 30af1f8fb0 Use inference_context with SDNQ 2025-07-14 13:07:44 +03:00
Disty0 3087b8d8cd Do not ignore offload with FramePack 2025-07-13 20:41:55 +03:00
Vladimir Mandic 4e449ca9b2 refactor monolithic shared.py and separate legacy options with logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-12 13:35:41 -04:00
Vladimir Mandic 4cec2db9a3 allow resize non-pil
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-12 09:44:42 -04:00
Vladimir Mandic 98afdd0a8a add freepix f-lite
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-11 13:19:29 -04:00
Vladimir Mandic 118a84813c fix directml by locking torch and transformers versions
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-11 10:39:35 -04:00
Vladimir Mandic 97de8ee5bf fix flux download
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-10 17:54:42 -04:00
Vladimir Mandic 286924c00a update
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-10 17:48:21 -04:00
Vladimir Mandic 25c56c2bde fixed omnigen flowmatch scheduler
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-10 17:44:30 -04:00
Vladimir Mandic c7ef692563 replace boundry with boundary
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-10 14:26:16 -04:00
Vladimir Mandic b1dfe19a37 fix omnigen2
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-10 14:19:35 -04:00
Vladimir Mandic 091bbd7bc6 video tab redesign and optimized ltxvideo
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-10 11:43:44 -04:00
Vladimir Mandic 8062345874 linting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-09 18:19:20 -04:00
Vladimir Mandic 3f5ab15f64 ltx-conditioned prototype
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-09 18:11:51 -04:00
Vladimir Mandic feca1c653f video ui update with modernui support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-09 11:54:58 -04:00
Vladimir Mandic 71a18dcf74 update precommit hooks
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-08 16:16:08 -04:00
Vladimir Mandic c559e26616 add builtin framepack
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-08 15:47:07 -04:00
Vladimir Mandic 9700cc765d cleanup gen infotext
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-07 20:09:19 -04:00
Vladimir Mandic e6d97f4d44 monkeypatch numpy for gradio
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-07 19:45:30 -04:00
Vladimir Mandic b625884031 add gemma3n to caption/vlm and promptenhance
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-07 10:01:02 -04:00
Vladimir Mandic 9246f447df fix resize visibility
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-06 22:13:42 -04:00
Vladimir Mandic a12f8cbc8d improve infotext param parsing
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-06 17:31:21 -04:00
Vladimir Mandic 4dc56c6813 allow styles to modify settings and improve parser
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-06 16:42:29 -04:00
Vladimir Mandic 6246047963 fix hypernetwork dir
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-06 15:43:28 -04:00
Vladimir Mandic ed1e59464e update requirements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-06 14:53:25 -04:00
Vladimir Mandic b2a52a146b fix ansi controle output and add model locking
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-06 12:50:09 -04:00
Vladimir Mandic 8dc5dac308 add face-yolo8m
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-06 11:47:27 -04:00
Disty0 148b011692 IPEX fix bicubic upsample with torchvision 2025-07-06 18:19:55 +03:00
Disty0 526976eb64
Merge pull request #4019 from vladmandic/master
PixelArt
2025-07-06 14:19:19 +03:00
Disty0 d5d857aa96 Add sharpen filter to pixelart 2025-07-06 03:17:54 +03:00
Disty0 e255d89fd8 Add PixelArt filter to postprocess 2025-07-06 02:30:55 +03:00
Vladimir Mandic 68708b6b8f refactor codeformer
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-05 18:33:55 -04:00
Vladimir Mandic edefa8cb14 improve extensions compatibility
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-05 17:42:13 -04:00
Vladimir Mandic d688514d0d set taesd as default preview type
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-05 17:30:54 -04:00
Vladimir Mandic 8c676d0a61 lint formatting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-05 17:13:31 -04:00
Vladimir Mandic a5b77b8ee2 remove dead code
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-05 16:47:25 -04:00
Vladimir Mandic 748ec564ad fix invalid model name on initial install
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-05 16:00:34 -04:00
Vladimir Mandic e8b5ea3847 major refactor: remove backend original
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-05 13:16:46 -04:00
Vladimir Mandic f408e5f315 major refactor: remove backend original
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-05 13:16:37 -04:00
Vladimir Mandic 2b9056179d add lbm background replace with relightining
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-04 15:33:16 -04:00
Disty0 4aeb9f004c Cleanup layerwise 2025-07-04 06:12:25 +03:00
Disty0 9d5571f4f8 Use layerwise casting with Flux FP8 models 2025-07-04 04:26:43 +03:00
Disty0 1a3b6e3b9c Handle all in one flux safetensors with auto quant mode 2025-07-04 02:35:54 +03:00
Disty0 fe9a3b8506 Add device map support to Flux and Chroma and add custom UNet support to Chroma 2025-07-04 02:22:42 +03:00
Disty0 f257cc2b40 Enable TAESD and Remote VAE for HunyuanDiT 2025-07-04 00:11:46 +03:00
Disty0 cf90e5621a Add _skip_layerwise_casting_patterns to SDNQ skip list 2025-07-04 00:04:01 +03:00
Disty0 07a443c196 Fix auth check with Flux from single file 2025-07-03 23:47:41 +03:00
Vladimir Mandic 49c9a450f4 support manually downloaded diffuser models
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-03 15:52:54 -04:00
Enes Sadık Özbek 9b82288fea
Fix xhinker padding for Chroma 2025-07-03 18:17:16 +03:00
Disty0 22e24b267c Update pillow jxl plugin 2025-07-03 17:48:52 +03:00
Enes Sadık Özbek e3beea1864
Fix colliding hashes for direct download diffusers models 2025-07-03 17:24:21 +03:00
Vladimir Mandic c4d9338d2e major refactoring of modules
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-03 09:18:38 -04:00
Vladimir Mandic 9b38a5dc58 add kontext inpainting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-02 08:14:47 -04:00
Disty0 3406083d14 Override lumina2 to use diffusers lora loading 2025-07-02 06:40:27 +03:00
Vladimir Mandic 7736382028 major requirements refactor
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-07-01 13:12:21 -04:00
Vladimir Mandic 4c43c1cc5e update cuda max memory limit
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-30 16:49:43 -04:00
Vladimir Mandic 5d2f5dd6e7 fix typo
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-30 08:28:11 -04:00
Enes Sadık Özbek f3d6245511
Fix not applying text encoders of LoRAs on prompts which caused the related LoRAs to load 2025-06-29 22:20:31 +03:00
Vladimir Mandic 198382c027 cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-29 12:58:54 -04:00
Vladimir Mandic ff103bc849 fix LoRA change detection on pipeline type change
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-29 12:52:37 -04:00
Vladimir Mandic 1b4e1ff0ef enable quants for vlm-captioning
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-29 11:48:05 -04:00
Disty0 99f323d105 Fix Linfusiong with quantization / compile 2025-06-29 18:17:05 +03:00
Disty0 bcea748d56 Omnigen 2 use LuminaFeedForward from diffusers 2025-06-28 18:35:57 +03:00
Vladimir Mandic 7fbac675fe api update default sampler
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-28 09:36:33 -04:00
Vladimir Mandic 69f71cc32a update nunchaku
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-28 07:50:35 -04:00
Disty0 ba45de1a08 Remove empty file 2025-06-28 14:14:50 +03:00
Disty0 1d9fe88528 Cleanup 2025-06-28 14:05:51 +03:00
Disty0 cb2fa7e1b4 Omnigen2 use SDPA 2025-06-28 14:02:15 +03:00
Disty0 ab8b9b0eab Cleanup Omnigen 2 2025-06-28 13:53:37 +03:00
Vladimir Mandic bff75f0db3 add omnigen2
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-27 20:20:43 -04:00
Vladimir Mandic 533aa04bbd improve taesd live preview downscaling
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-27 18:16:32 -04:00
Vladimir Mandic 1d8551788a update changelog and cleanup samplers
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-27 17:02:25 -04:00
Disty0 71f7474de2 Unify quant options 2025-06-27 21:05:14 +03:00
Disty0 3b8ced444c Add auto quantization mode 2025-06-27 18:54:15 +03:00
Vladimir Mandic 15cbffeb97 cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-27 09:52:31 -04:00
Vladimir Mandic 78330142ae add moondream2, sdnq xyzgrid timing info
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-27 09:41:32 -04:00
Vladimir Mandic f9480a1047 add --trace for trace-logging and suppress empty torch logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-27 09:04:32 -04:00
Vladimir Mandic 518015d0d1 fix lumina2
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-27 08:30:25 -04:00
Vladimir Mandic 1147f9ec56 add flux.1-kontext-dev
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-26 17:09:53 -04:00
Vladimir Mandic d6a8d2b173 cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-26 15:00:27 -04:00
Vladimir Mandic 46387d0c01 cleanup chroma
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-26 14:48:17 -04:00
Disty0 0e4d712f27 Chroma fixes 2025-06-26 21:25:50 +03:00
Vladimir Mandic d5a74d4a4a
Merge branch 'dev' into feature/chroma-support 2025-06-26 13:06:31 -04:00
Vladimir Mandic ada38d57b4 add nvidia-cosmos-predict-2
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-26 12:21:43 -04:00
Disty0 61e949c1cc Update OpenVINO to 2025.2.0 2025-06-26 18:33:04 +03:00
Enes Sadık Özbek e91208bea9
Merge branch 'dev' into feature/chroma-support 2025-06-26 17:02:00 +03:00
Vladimir Mandic 2714d29993 fix unapply texture tiling
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-26 09:30:15 -04:00
Vladimir Mandic 931650c43f fix process batch
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-26 09:17:10 -04:00
Vladimir Mandic 82aaff9d70 gallery trace file fetch
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-26 07:59:51 -04:00
Vladimir Mandic 4de160608e fix prompt parser with batch size
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-26 07:47:03 -04:00
Vladimir Mandic 7380c08f8e lint fix
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-26 06:51:59 -04:00
Disty0 0f6eb624c9 Use llm_int8_skip_modules with bnb 2025-06-26 03:10:26 +03:00
Disty0 dc8fd006b2 Add modules_to_not_convert to pre-mode quants 2025-06-26 02:47:10 +03:00
Vladimir Mandic c254c8c1ec fix hypertile for img2img and inpaint operations
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-25 19:14:46 -04:00
Enes Sadık Özbek fb0d354c4e
reuse f1 remote vae for chroma 2025-06-26 02:04:03 +03:00
Enes Sadık Özbek f040d67f64
another merge conflict 2025-06-26 01:58:09 +03:00
Enes Sadık Özbek 943b45fdb6
fix the previous merge conflict 2025-06-26 01:57:15 +03:00
Enes Sadık Özbek 21bdde12d3
Merge branch 'dev' into feature/chroma-support 2025-06-26 01:56:34 +03:00
Disty0 c25d15398f SDNQ pre-mode don't quant if weights_dtype == 'none' 2025-06-26 01:48:01 +03:00
Vladimir Mandic 2c629246d4
Merge branch 'dev' into fix-lycoris-wrong-errors 2025-06-25 18:45:04 -04:00
Vladimir Mandic 42b3e08e65 Control add setting to run hires with or without control
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-25 18:43:29 -04:00
Disty0 c9f49720c5 Cleanup 2025-06-25 23:37:41 +03:00
Disty0 e43d1d2ba7 SDNQ use strings as target_dtype 2025-06-25 23:25:49 +03:00
Disty0 81e55f0459 Fix SDNQ pre-mode 2025-06-25 22:58:40 +03:00
Vladimir Mandic f8977d2f01 add /sdapi/v1/controlnets api endpoint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-25 15:54:43 -04:00
Vladimir Mandic 5b486a6ef1 sdnq add xyz grid support, improve offloading compatibility
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-25 15:32:37 -04:00
Vladimir Mandic 6c3f0dd43b add `SD_SAVE_DEBUG` env variable
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-25 11:23:39 -04:00
Vladimir Mandic 3d52e3fe9f add /sdapi/v1/lora endpoint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-25 10:54:02 -04:00
Vladimir Mandic a5d784f073 fix delete file from main gallery view
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-25 10:30:59 -04:00
Vladimir Mandic b650618b27 fix params.txt
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-06-25 09:11:17 -04:00
Disty0 77db759d88 Cleanup 2025-06-24 13:15:31 +03:00
Disty0 eaa130463c Use Diffusers with OmniGen 2025-06-24 13:09:11 +03:00
Disty0 bbf986d3a5 Fix LTXVideo 2025-06-23 17:37:20 +03:00
Enes Sadık Özbek 4870605f4a
Update prompt_parser_xhinker.py 2025-06-23 13:41:49 +03:00
Enes Sadık Özbek 9238150a56
fix eos token not added correctly 2025-06-23 10:15:35 +00:00
Enes Sadık Özbek 71869a3181
xhinker improvements 2025-06-23 08:41:15 +00:00
Enes Sadık Özbek 405416871f
fix chroma teacache 2025-06-23 08:35:05 +00:00
Enes Sadık Özbek 106f6a9bc1
xhinker padding fixes 2025-06-23 02:18:50 +00:00
Enes Sadık Özbek 954138bfc1
add attention masks 2025-06-23 01:27:40 +00:00
Disty0 87e6d3f4fc SDNQ add modules_to_not_convert and don't quant _keep_in_fp32_modules layers in post mode 2025-06-20 20:41:11 +03:00
Disty0 4491d26a18 IPEX fix fp64 hijack 2025-06-19 22:55:28 +03:00
Disty0 7fc7797a1d SDNQ fix group size calc on odd shapes 2025-06-19 11:36:41 +03:00
Disty0 ff5d7977a9 Fix Controlnet pipeline check on set atten 2025-06-18 19:35:57 +03:00
Disty0 2c4850cc2b Log more info with SDNQ 2025-06-18 18:03:46 +03:00
Disty0 86cd272b96 SDNQ fix Dora 2025-06-18 16:24:42 +03:00
Enes Sadık Özbek 7025ac8c36
Merge branch 'dev' into feature/chroma-support 2025-06-18 10:08:38 +03:00
Enes Sadık Özbek 4b3ce06916
Initial support for Chroma 2025-06-18 00:38:17 +00:00
Disty0 e657cf790d SDNQ fix int8 matmul with qwen 2025-06-18 02:12:34 +03:00
Disty0 71c2714edf Cleanup 2025-06-17 20:04:15 +03:00
Disty0 d8aaffbc27 IPEX fix DPM2++ FlowMatch 2025-06-17 19:58:20 +03:00
Disty0 26800a1ef9 Cleanup sdnq 2025-06-17 02:05:13 +03:00
Disty0 bddd091300 Custom VAE loading support for Lumina 2 2025-06-16 22:34:02 +03:00
Disty0 319af31d25 Custom UNet loading support for Lumina 2 2025-06-16 13:28:30 +03:00
Disty0 892dd456f7 Fix Nunchaku 2025-06-16 02:43:49 +03:00
Disty0 4fa48e4084 Use te hijcak for with lumina 2 2025-06-15 22:19:56 +03:00
Disty0 a7811da267 Teacache support for Lumina 2 2025-06-15 22:07:58 +03:00
Disty0 d31df8c1eb SDNQ fuse bias into dequantizer with matmul 2025-06-14 22:10:10 +03:00
Disty0 25fc0094a9 SDNQ use quantize_device and return_device args and fix decompress_fp32 always being on 2025-06-14 21:29:08 +03:00
Disty0 24194201cf Fix OmniGen 2025-06-14 19:55:43 +03:00
Disty0 c01802d9ff SDNQ fix transformers llm 2025-06-14 01:13:51 +03:00
Disty0 8f8e5ce1b0 Cleanup x2 2025-06-14 01:08:25 +03:00
Disty0 2ba64abcde Cleanup 2025-06-14 00:54:18 +03:00
Disty0 45827a923f IPEX fix torch.cuda.set_device 2025-06-13 16:20:21 +03:00
Disty0 90e76b2023 Cleanup 2025-06-13 13:42:13 +03:00
Disty0 fb7280c3f4 Flux quanto fix logged dtype 2025-06-13 13:40:44 +03:00
Disty0 1fca565178 Cleanup 2025-06-13 13:37:12 +03:00
Disty0 e68f9272e8 Disable custom atten processors for non SD 1.5 / SDXL models 2025-06-13 13:05:46 +03:00
Disty0 cb4684cbeb SNDQ add separate quant mode option for Text Encoders 2025-06-13 12:42:57 +03:00
Disty0 c8f947827b IPEX fix Lumina2 2025-06-12 19:46:05 +03:00
Disty0 41f14df8f5 Fix TAESD and double downloading with Lumina2 2025-06-12 14:17:36 +03:00
Disty0 5e013fb154 SDNQ optimize input quantization and use the word quantize instead of compress 2025-06-12 12:06:57 +03:00
Disty0 2d05396b4e SDNQ simplify sym scale formula 2025-06-12 02:26:04 +03:00
Disty0 26545b6483 Add warning for incompatible attention processors 2025-06-11 21:59:59 +03:00
Disty0 dd84fb541f Always set sdpa params 2025-06-11 21:43:48 +03:00
Disty0 5cefa64a60 SDNQ update accepted dtypes 2025-06-11 20:58:54 +03:00
Disty0 74b6edf2df revert gfx1101 2025-06-11 19:25:05 +03:00
Disty0 6aa5c08fb0 Cleanup and update changelog 2025-06-11 16:03:33 +03:00
Disty0 71be3c7d45 ROCm don't override gfx with gfx1100 and gfx1101 + rocm 6.4 2025-06-11 15:47:25 +03:00
Disty0 df6b13ea47 Don't set gfx override with RX 9000 and above 2025-06-11 15:09:03 +03:00
Disty0 c81b712ddb Make VAE options not require model reload 2025-06-10 15:56:19 +03:00
Disty0 78f99abec8 SDNQ use group_size / 2 for convs 2025-06-10 15:29:24 +03:00
Disty0 33fadf946b SDNQ add 7 bit support 2025-06-10 11:33:06 +03:00
Disty0 5bd7a08877 don't use inplace ops in quant layer 2025-06-10 03:29:07 +03:00
Disty0 5eed9135e3 Split SDNQ into multiple files and linting 2025-06-10 03:18:25 +03:00
Disty0 58b646e7f2 SDNQ add 5-bit and 3-bit quantization support 2025-06-10 01:48:51 +03:00
Disty0 bd2d9d1677 Python 3.13 support 2025-06-09 22:58:08 +03:00
Disty0 8e08ef0edc Fix VAE Tiling with non-default tile sizes 2025-06-07 01:25:08 +03:00
Enes Sadık Özbek 3868a9184b
Fix incorrectly reported lycoris load error 2025-06-07 00:36:08 +03:00
Disty0 2f7aff5250 Fix TAESD previews with PixArt 2025-06-06 19:43:00 +03:00
Disty0 5624671191 Fix PixArt Sigma Small and Large 2025-06-06 19:25:26 +03:00
Disty0 089e437708 Don't set attention processors with models outside of SD 1.5 and SDXL 2025-06-06 18:53:57 +03:00
Disty0 c039ba90f6 Fix Meissonic by adding multiple generator support 2025-06-06 18:02:49 +03:00
Disty0 7679028c1a Override CPU to use FP32 by default 2025-06-06 15:33:51 +03:00
Disty0 2ccc76ab91 Increase medvram mode to 12 GB and update wiki 2025-06-06 15:27:30 +03:00
Disty0 9a54efda9b Cleanup 2025-06-06 01:55:35 +03:00
Disty0 06fcc3cf85 SDNQ add quantized matmul support for Conv1d and Conv3d too 2025-06-06 00:19:54 +03:00
Disty0 976f0ba61f Cleanup 2025-06-05 20:59:58 +03:00
Disty0 413cf54cb6 Update changelog 2025-06-05 18:11:36 +03:00
Disty0 8c03f78197 Fix bias is None 2025-06-05 14:37:00 +03:00
Disty0 1a00517338 SDNQ FP8 matmul support for Conv2d 2025-06-05 14:32:26 +03:00
Disty0 9b55ffe449 SDNQ fix VAE x2 2025-06-05 14:17:59 +03:00
Disty0 ad2a4ad616 Cleanup 2025-06-05 13:38:04 +03:00
Disty0 e25890bb1d SDNQ INT8 matmul support for Conv2d 2025-06-05 13:36:49 +03:00
Disty0 c7fb5b1690 SDNQ fix VAE quant 2025-06-05 13:24:02 +03:00
Disty0 ce3a6e27fa SDNQ use channelwise only quant 2025-06-03 12:30:19 +03:00
Disty0 79ec23dd9d SDNQ override conv dtype 2025-06-03 02:37:29 +03:00
Disty0 e9ff242e03 SDNQ add group size support for convs 2025-06-03 02:16:52 +03:00
Disty0 6f637f41cc Use tensorwise fp8 matmul with torch < 2.5 2025-06-02 23:28:49 +03:00
Disty0 3f3a986c0e SDNQ fix scale staying in fp32 with tensorwise fp8 matmul 2025-06-02 23:18:28 +03:00
Disty0 4e3795a0a5 SDNQ fix packed int8 matmul 2025-06-02 03:31:51 +03:00
Disty0 82f5634d53 SDNQ use torch.bool for uint1 2025-06-02 01:39:51 +03:00
Disty0 ea7fe3bb73 OpenVINO update dtype_mapping 2025-06-02 01:11:41 +03:00
Disty0 e8588c91ea SDNQ enable matmul support for float8_e5m2 2025-06-02 00:53:10 +03:00
Disty0 8f1a1d7311 SDNQ expand quantized_matmul_dtypes for CPU 2025-06-02 00:28:29 +03:00
Disty0 b146025a5e SDNQ add int2 2025-06-02 00:17:39 +03:00
Disty0 9669b36010 SDNQ fix older PyTorch with FP8 matmul 2025-06-01 23:29:16 +03:00
Disty0 acefa58834 SDNQ don't force fp32 with fp8 tensorwise matmul 2025-06-01 23:16:00 +03:00
Disty0 839295f79a Add fp8 fnuz to sdnq options 2025-06-01 23:10:08 +03:00
Disty0 539fae3234 Update naming 2025-06-01 21:01:56 +03:00
Disty0 cefe460052 SDNQ skip FP8 matmul for input len < 32 2025-05-31 01:27:59 +03:00
Disty0 046840c8be Fix HiDream sampling 2025-05-31 00:52:56 +03:00
Disty0 109c0d7e49 SDNQ use tensorwise FP8 matmul on CPU 2025-05-30 21:09:53 +03:00
Disty0 959b759721 Cleanup 2025-05-30 16:45:59 +03:00
Disty0 b5d588fa45 SDNQ remove unnecessary bitwise ands 2025-05-30 16:29:59 +03:00
Disty0 db816d7088 Cleanup 2025-05-30 16:02:26 +03:00
Disty0 c85cc6b397 SDNQ enable quant with GPU by default and don't do unnecessary clones 2025-05-30 15:21:29 +03:00
Disty0 4654acde3c SDNQ re-enable memory fix for diffusers 2025-05-30 14:59:45 +03:00
Disty0 87a801e24d SDNQ remove memory fix hijack 2025-05-30 13:54:49 +03:00
Disty0 f81cb22c00 SDNQ fix new transformers 2025-05-30 13:32:03 +03:00
Disty0 36febda6e6 SDNQ update supported dtypes 2025-05-30 13:07:23 +03:00
Disty0 29bd2af779 SDNQ add 6-bit support 2025-05-30 12:20:13 +03:00
Vladimir Mandic 98a11fc86c fix gallery duplicate entries
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-30 11:04:56 +02:00
Disty0 d1491962d9 One bit 2025-05-30 05:41:02 +03:00
Disty0 3c8be0f55f SDNQ add uint2 2025-05-30 04:47:29 +03:00
Disty0 599224d392 SDNQ reduce 5 reshape ops to 2 with quantized input 2025-05-30 01:31:41 +03:00
Disty0 d8dea9031f SDNQ do FP8 matmul shape check only once 2025-05-30 01:13:37 +03:00
Disty0 b4e615e760 SDNQ add FP8 row wise scaling workaround for SM89 on Windows 2025-05-30 00:16:54 +03:00
Disty0 54154cf698 Cleanup 2025-05-29 20:22:49 +03:00
Disty0 90324f9c8c SDNQ fix lora with quant matmul 2025-05-29 18:25:12 +03:00
Disty0 df8b31fcfc Don't downcast scale with fp8 matmul 2025-05-29 16:35:40 +03:00
Disty0 2351efb8f7 Remove redundant shape check 2025-05-29 14:58:00 +03:00
Disty0 14893b7617 Don't make the weights contiguous with int8 matmul 2025-05-29 03:43:57 +03:00
Disty0 2cc5a58b0f Update changelog 2025-05-29 03:26:47 +03:00
Disty0 67e0f4d833 Cleanup 2025-05-29 03:22:40 +03:00
Disty0 3698f8bb84 SDNQ add experimental FP8 matmul 2025-05-29 03:11:59 +03:00
Disty0 dd33c4d583 Fix scale and zero_point not being moved by tensor.to 2025-05-28 17:46:06 +03:00
Disty0 dd0dbc476f SDNQ fix asym quant formula for dtypes with non zero minimums 2025-05-28 17:25:38 +03:00
Disty0 e06cbea7aa Cleanup 2025-05-28 15:55:08 +03:00
Disty0 d8e8f47ce5 SDNQ add an option to toggle quantize with GPU 2025-05-28 15:18:39 +03:00
Disty0 1961e88c13 Set SDPA as the default on all backends and enable Dyn SDPA on ROCm, DML, CPU and MPS 2025-05-28 13:42:29 +03:00
Disty0 569e9099d7 Use torch.amax instead of torch.max 2025-05-28 12:44:07 +03:00
Disty0 0b564e2373 Cleanup 2025-05-28 04:07:45 +03:00
Disty0 1433dfe3de SDNQ fix high RAM usage with pre mode 2025-05-28 03:16:29 +03:00
Disty0 4ed15f5cce SDNQ revert device_map = gpu 2025-05-27 23:32:58 +03:00
Disty0 d3e3fb98b0 Don't override user set device_map 2025-05-27 21:45:52 +03:00
Disty0 b1b29e9001 SDNQ disable device_map = gpu with TE and LLM 2025-05-27 21:32:32 +03:00
Disty0 b724cd7c57 Update changelog 2025-05-27 21:21:42 +03:00
Disty0 5d3c1832b2 SDNQ add FP8 quants 2025-05-27 20:29:15 +03:00
Disty0 3618e39cff SDNQ use device_map = gpu 2025-05-27 19:46:30 +03:00
Disty0 73999ac710 Add soft gc to nncf quant layer 2025-05-27 16:24:04 +03:00
Disty0 e94128a02e SDNQ add force torch_gc to pre load mode 2025-05-27 16:11:04 +03:00
Disty0 dece497f10 Refactor SDNQ to use weights_dtype and rename decompress_int8_matmul to use_quantized_matmul 2025-05-27 15:49:21 +03:00
Disty0 79bb348927 SDNQ sort quant schemes by recommended order 2025-05-27 13:06:17 +03:00
Disty0 dec460e665 SDNQ use torch.bitwise ops instead of python 2025-05-27 03:02:36 +03:00
Disty0 280be31883 SDNQ fix Lora change 2025-05-27 00:08:32 +03:00
Disty0 4d9c2a8608 Cleanup 2025-05-26 22:41:12 +03:00
Disty0 84ddfb2868 SDNQ fix lora apply 2025-05-26 22:39:20 +03:00
Disty0 6dee9f5ac7 Fix HiDream teacache not reseting 2025-05-26 21:21:01 +03:00
Disty0 742cd61d1f Add TeaCache for HiDream 2025-05-26 19:59:43 +03:00
Disty0 687c50dcc8 SDNQ fix Lora 2025-05-26 19:48:45 +03:00
Disty0 ccf9deaf28 Move SDNQ to the top of the settings list 2025-05-26 18:30:50 +03:00
Disty0 02f15b28cc Cleanup 2025-05-26 15:57:17 +03:00
Disty0 91bb07f650 SDNQ remove unused args and simplify decompressors 2025-05-26 15:51:53 +03:00
Disty0 d2159af10e cleanup 2025-05-26 04:24:28 +03:00
Disty0 4ad404182d cleanup 2025-05-26 04:17:22 +03:00
Disty0 46e9a9a631 IPEX disable Dynamic Attention by default on PyTorch 2.7 2025-05-26 03:03:17 +03:00
Disty0 4453efee76 Rename NNCF to SDNQ and rename quant schemes 2025-05-26 02:39:51 +03:00
Disty0 9c2e15433e NNCF set required_packages to None 2025-05-26 01:39:09 +03:00
Disty0 cbc1bfe710 Cleanup 2025-05-26 01:24:06 +03:00
Disty0 2d79380bd7 NNCF implement better layer hijacks and remove all NNCF imports 2025-05-26 01:12:28 +03:00
Vladimir Mandic af3a44ccbe optional skimage
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-24 08:58:04 +02:00
Disty0 85f00f9edb Enable dyn atten by default for ROCm 2025-05-23 18:24:50 +03:00
Disty0 3d8390de9b IPEX return devices.dtype instead of bf16 2025-05-18 04:44:51 +03:00
Disty0 d0e6f01286 IPEX remove GradScaler and use torch.amp instead 2025-05-18 04:39:48 +03:00
Disty0 a009e17d2b NNCF use per token input quantization with int8 matmul 2025-05-17 19:46:47 +03:00
Disty0 219970d47d Add Anisora 5B RL 2025-05-16 12:00:54 +03:00
Disty0 8487b5f263 Add Anisora 5B 2025-05-15 23:21:39 +03:00
Disty0 cf716e1c97 NNCF fix CogVideo 2025-05-15 22:51:35 +03:00
Vladimir Mandic c371ec91b4 fix nncf with controlnet
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-15 15:26:55 -04:00
Disty0 0ab28a6106 IPEX fix cogvideo 2025-05-15 22:08:50 +03:00
Vladimir Mandic 4157336238 rename vae
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-15 08:59:49 -04:00
Vladimir Mandic 39135c1d0a ui-defaults match correct prompt component
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-15 08:51:03 -04:00
Vladimir Mandic 5c0e3b635c update diffusers and lint/changelog/todo
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-14 13:30:52 -04:00
Seunghoon Lee 8330052d19
zluda 3.9.5 & torch 2.7.0 2025-05-14 13:22:26 +09:00
Disty0 18c10883b8 Move NNCF above in the settings list 2025-05-14 05:19:11 +03:00
Vladimir Mandic 8473bae0fc 1000 papercuts
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-13 21:51:33 -04:00
Disty0 115d81cc8c NNCF change zero_point formula and use torch.addcmul on decompress_asym 2025-05-14 00:58:33 +03:00
Disty0 361e952a64 Cleanup 2025-05-14 00:14:24 +03:00
Vladimir Mandic f07c2e6117 nncf-lint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-13 12:35:33 -04:00
Vladimir Mandic bfda37903c update nncf linting and changelog
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-13 12:11:10 -04:00
Disty0 4e4557d81c NNCF set min matmul shape to 32 2025-05-13 18:50:23 +03:00
Disty0 b9ad55857d NNCF INT8 MatMul don't force FP32 with FP16 scales 2025-05-13 05:08:22 +03:00
Disty0 129c701b3d NNCF use torch.compile directly on int8_matmul instead of sub functions 2025-05-13 04:28:37 +03:00
Disty0 f1eefe97a4 NNCF use inplace ops 2025-05-13 03:49:30 +03:00
Vladimir Mandic 47862fef08 prompt enhance nsfw allow/disallow
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-12 20:33:16 -04:00
Disty0 98ccce68a1
Merge branch 'master' into master 2025-05-13 03:28:51 +03:00
chrismuzyn 299d189276 When using the openvino backend, do not look for an nvidia gpu. 2025-05-12 19:14:26 -04:00
Disty0 f4e3a81a84 NNCF experimental direct INT8 MatMul support 2025-05-12 21:41:49 +03:00
Vladimir Mandic 91080f349f latent-diffusion-upscale n-steps
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-12 11:12:36 -04:00
Vladimir Mandic a6e6c6ce5e support sdxl packaged without vae
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-11 14:49:27 -04:00
Disty0 4eedeab9f8 NNCF use group size instead of number of groups and set default group size for int4 to 64 2025-05-11 20:38:01 +03:00
Disty0 03d05b6243 NNCF fix very large number of groups 2025-05-11 18:43:19 +03:00
Disty0 9cfdc3c079 Remove NNCF device hijack 2025-05-11 18:30:10 +03:00
Disty0 0673689d5b NNCF set the default group size to 128 for INT4 2025-05-11 08:45:27 +03:00
Disty0 4af570bfd4 Cleanup 2025-05-11 08:10:13 +03:00
Disty0 8d27d34969 NNCF don't clip the zero_point 2025-05-11 07:57:51 +03:00
Disty0 98308fa187 NNCF fix group size calculation 2025-05-11 07:08:21 +03:00
Disty0 020e1aa374 Cleanup 2025-05-11 06:56:36 +03:00
Disty0 03a6d7f9bf NNCF add number of quantization groups 2025-05-11 05:55:58 +03:00
Vladimir Mandic 6036ff2105 modernui framepack and history tabs
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-10 10:21:37 -04:00
Vladimir Mandic aa04dd900a fix modernui disabled
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-10 08:53:30 -04:00
Vladimir Mandic f0d81ee1e0 cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-10 08:28:19 -04:00
Seunghoon Lee 6d2b5fc37c
Merge pull request #3921 from alexsarmiento/patch-1
Update fwd_prefill.py
2025-05-10 11:47:26 +09:00
Disty0 a1491a660c Cleanup 2025-05-09 23:36:50 +03:00
Disty0 1ee9832e05 NNCF silence the pytorch version warning 2025-05-09 23:16:55 +03:00
Disty0 b0e5a6c4df Add devices.has_triton() and enable NNCF compile if triton is available 2025-05-09 22:24:36 +03:00
AS 399a630778
Merge branch 'dev' into patch-1 2025-05-09 11:18:25 -07:00
Disty0 a4d4462e2a NNCF add decompress using toch.compile option 2025-05-09 21:02:24 +03:00
Seunghoon Lee 45c0bd6ec6
basic windows native pytorch support 2025-05-09 22:23:07 +09:00
Vladimir Mandic 51716bbaba update diffusers
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-09 09:04:21 -04:00
Vladimir Mandic 808462fdab update changelog
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-09 08:18:40 -04:00
Seunghoon Lee a27abf7363
zluda fix old cards 2025-05-09 20:02:45 +09:00
Disty0 9b641becd5 IPEX fix torch.compile with tensor.to 2025-05-09 11:07:51 +03:00
Seunghoon Lee 18f58e13f8
Update fwd_prefill.py 2025-05-09 13:36:01 +09:00
Vladimir Mandic 9e18d2f658
Merge branch 'dev' into patch-1 2025-05-08 23:21:24 -04:00
AS 5e561560ea
Update fwd_prefill.py
Remove cudagraph from triton autotune. Buggy under zluda
2025-05-08 19:32:51 -07:00
Vladimir Mandic 6489e4c37d prompt-enhance api support and img2img support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-08 15:31:07 -04:00
Vladimir Mandic 55b1cb8c8b lower default teacache threshold
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-08 10:14:15 -04:00
Vladimir Mandic 432a5977a7 adetailer fix enable-disable
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-08 10:10:43 -04:00
Disty0 f3aa3b4574 NNCF remove T5 hijack from pre quant mode 2025-05-08 14:11:19 +03:00
Disty0 dfebc909eb Disable cuDNN benchmark on ROCm and add cudnn_benchmark_limit option 2025-05-08 13:27:06 +03:00
Vladimir Mandic 8433f685e7 clear-cache on model unload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-07 20:22:30 -04:00
Disty0 b6d2aa7fd8 NNCF more optimizations 2025-05-07 21:50:31 +03:00
Disty0 a57c7087b8 Make NNCF INT4 quant run 75% faster and don't force fp32 decompress 2025-05-07 20:34:07 +03:00
Vladimir Mandic 5261c55890 fix lora legacy disabled
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-07 11:48:21 -04:00
Vladimir Mandic 78e22350b9 add api get-checkpoint
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-07 10:31:06 -04:00
Seunghoon Lee 2a4eb86d10
zluda 3.9.4 & update flash attention 2 2025-05-07 00:39:40 +09:00
Vladimir Mandic 83fc68ece3 update requirements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-06 09:47:13 -04:00
Vladimir Mandic 02fd0aee06 fix control refiner
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-06 09:06:50 -04:00
Vladimir Mandic 1da43e4f62 api b64 error handler
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-05 22:28:03 -04:00
Vladimir Mandic 66b2505422 fix cmdargs
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-05 16:52:01 -04:00
Vladimir Mandic d12cfdb537 add vlm prompt enhancer
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-05 12:39:45 -04:00
Vladimir Mandic 5971f67e4f fix cn steps
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-04 15:04:20 -04:00
Vladimir Mandic 7aa09957dc fix lllite
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-04 13:55:45 -04:00
Vladimir Mandic 7ebc3fe94c t2i-adapter
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-04 12:53:04 -04:00
Vladimir Mandic 25470e5524 fix sdxl-refiner workflow
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-04 12:12:09 -04:00
Disty0 f4dfe20bc1 Add sigmoid beta scheduler 2025-05-04 17:42:22 +03:00
Vladimir Mandic 0ef2249d55
Merge pull request #3903 from TsarFox/fix-vlm-api
Add `system` field to `ReqVQA`
2025-05-02 13:21:03 -04:00
Jakob L. Kreuze e6be2a6cdc
Add `system` field to `ReqVQA` 2025-05-02 11:13:29 -04:00
Vladimir Mandic 2db573e625 log gated access
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-05-01 12:56:07 -04:00
Disty0 dca11dd806 Add jxl to image extension lists 2025-05-01 16:02:50 +03:00
Disty0 5cb8bad576 IPEX fix diffusers hijacks 2025-04-30 22:35:52 +03:00
Vladimir Mandic a84b77d396 fix texture tiling
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-30 09:44:34 -04:00
Vladimir Mandic 473f394f97 fix save style
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-30 09:18:41 -04:00