Vladimir Mandic
|
20f2554cec
|
add sd35-ipadapter and more balanced offload optimizations
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-20 10:22:42 -05:00 |
Vladimir Mandic
|
e9f951b2c5
|
offload logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-11 14:20:01 -05:00 |
Vladimir Mandic
|
9a588d9c91
|
update balanced offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-11 12:06:03 -05:00 |
Vladimir Mandic
|
023b13b6cb
|
balanced offload improvements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-01 15:34:25 -05:00 |
Vladimir Mandic
|
b7aff134a2
|
add low/high threshold to balanced offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-11-30 19:03:51 -05:00 |
Vladimir Mandic
|
b74166f9cb
|
detailer add augment setting
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-11-29 07:18:07 -05:00 |
Vladimir Mandic
|
dbb9ba0890
|
cuda memory limits
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-10-26 07:51:40 -04:00 |
Seunghoon Lee
|
a76893bd72
|
add cdna check
|
2024-10-26 14:09:50 +09:00 |
Seunghoon Lee
|
81bd236cc3
|
zluda&rocm bf16 test
|
2024-10-26 13:59:21 +09:00 |
Disty0
|
d459acfcca
|
Cleanup
|
2024-10-24 20:08:49 +03:00 |
Disty0
|
3b916d5e48
|
Zluda guess the GPU arch with the device name
|
2024-10-24 18:53:17 +03:00 |
Disty0
|
801ebdd080
|
Treat Zluda as a different backend and auto disable BF16 for Zluda and ROCm on RDNA1-2
|
2024-10-24 15:06:39 +03:00 |
Vladimir Mandic
|
0587f0be0c
|
gc logging
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-10-23 07:58:09 -04:00 |
Vladimir Mandic
|
64f363283f
|
messages,stats,save
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-10-20 09:26:07 -04:00 |
Disty0
|
6c11002420
|
PyTorch 2.5 XPU support
|
2024-10-17 23:11:52 +03:00 |
Disty0
|
b14e8f9a5f
|
Don't assume Cuda on devices.same_device()
|
2024-10-14 17:23:51 +03:00 |
Vladimir Mandic
|
c2ab0b11c3
|
check te device
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-10-14 09:29:33 -04:00 |
Disty0
|
9c05124c33
|
Add devices.has_xpu()
|
2024-10-13 15:13:38 +03:00 |
Disty0
|
011d9c3348
|
Move device backed initialization to shared.py
|
2024-10-13 14:56:28 +03:00 |
Disty0
|
84f8ab4076
|
Fix IPEX
|
2024-10-13 14:24:55 +03:00 |
Vladimir Mandic
|
0c54c235cb
|
add sageattention
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-10-12 15:43:34 -04:00 |
Disty0
|
2e2cb43406
|
Make SDPA hijacks chainable and add Sage Attention
|
2024-10-12 21:19:38 +03:00 |
Vladimir Mandic
|
ea0dfebe2d
|
better handle any quant lib requirements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-10-12 13:36:16 -04:00 |
Vladimir Mandic
|
3bbcc33181
|
add detailer
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-10-07 09:32:56 -04:00 |
Vladimir Mandic
|
c21a10b7c9
|
add bf16 override for directml
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-09-29 21:34:59 -04:00 |
Vladimir Mandic
|
b31d02ba1d
|
cleanup
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-09-29 20:28:01 -04:00 |
Vladimir Mandic
|
47755dce6b
|
refactor devices
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-09-29 20:17:03 -04:00 |
Vladimir Mandic
|
fe94edf781
|
set default cuda dtype to auto
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-09-29 14:16:14 -04:00 |
Vladimir Mandic
|
174add0c3a
|
restore dtype after upcast complete
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-09-29 13:22:08 -04:00 |
Vladimir Mandic
|
92f2a2902f
|
improve profiling
|
2024-09-23 11:07:24 -04:00 |
Vladimir Mandic
|
fe93ad6929
|
refactor xyzgrid
|
2024-09-13 19:22:02 -04:00 |
Disty0
|
586e5384b5
|
Update IPEX to 2.3 on Linux
|
2024-09-10 19:13:42 +03:00 |
Vladimir Mandic
|
b4df9a4de1
|
jumbo update with flux.1 refactor, see changelog for details
|
2024-09-01 22:56:15 -04:00 |
Vladimir Mandic
|
5ed58ac7cc
|
end-to-end update flux, see changelog and wiki
|
2024-08-28 08:04:24 -04:00 |
Disty0
|
a3f26c9df0
|
Convert Dynamic Attention SDP to a global SDP option
|
2024-08-18 01:44:27 +03:00 |
Disty0
|
f2769c0449
|
ROCm flash atten fall back to sdpa with fp32 inputs
|
2024-07-23 01:13:55 +03:00 |
xedis
|
809444eb5c
|
fix typo
|
2024-07-03 23:11:08 -07:00 |
Vladimir Mandic
|
16ab1a0af7
|
lint updates
|
2024-06-26 08:58:22 -04:00 |
Vladimir Mandic
|
b036c2fc3b
|
improve gc threshold
|
2024-06-21 12:57:17 -04:00 |
Disty0
|
092a326c09
|
Add torch_gc to state.nextjob, vae and upscale
|
2024-06-20 14:47:30 +03:00 |
Vladimir Mandic
|
a1f53add94
|
fix typos
|
2024-06-16 17:00:35 -04:00 |
Vladimir Mandic
|
6d6f1de295
|
additional python 3.12 compatibility
|
2024-06-08 14:14:48 -04:00 |
Vladimir Mandic
|
db9718eee6
|
add torch full deterministic mode
|
2024-06-07 09:26:51 -04:00 |
Vladimir Mandic
|
d63f35e298
|
add cudaMallocAsync
|
2024-05-16 18:02:55 -04:00 |
Vladimir Mandic
|
40d5fdfdfd
|
maybe fix slerp
|
2024-04-03 17:51:06 -04:00 |
Vladimir Mandic
|
834cb1b665
|
run fp16/bf16 test only once
|
2024-04-03 10:26:29 -04:00 |
Vladimir Mandic
|
9873178897
|
add extra_network_reference setting, refactor geninfo parser
|
2024-03-11 11:15:51 -04:00 |
Disty0
|
06149c4a41
|
ROCm add Flash Attention support
|
2024-03-10 00:11:50 +03:00 |
Vladimir Mandic
|
ee7517dfb8
|
expose sdp options
|
2024-02-19 08:29:24 -05:00 |
Vladimir Mandic
|
1b3028b667
|
minor update
|
2024-02-15 09:13:34 -05:00 |