Vladimir Mandic
|
f4fdd496b9
|
more granular quantization modules options
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-03-28 14:46:52 -04:00 |
Vladimir Mandic
|
d1c3b97c65
|
add prompt enhance
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-03-28 14:05:28 -04:00 |
Vladimir Mandic
|
4f56f4aa33
|
add new optimum-quanto on-the-fly and simplify quantization loading
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-03-16 21:45:05 -04:00 |
Vladimir Mandic
|
a5d3a68107
|
add cogview4
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-03-15 13:20:17 -04:00 |
Vladimir Mandic
|
49712ab9e7
|
update requirements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-02-13 12:03:08 -05:00 |
Vladimir Mandic
|
a7ccea60ff
|
add lumina2
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-02-12 08:54:00 -05:00 |
Vladimir Mandic
|
61a98b0b7b
|
fix bnb version
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-02-01 16:09:31 -05:00 |
Vladimir Mandic
|
06ba03cf80
|
settings option to disable reference models
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-01-23 15:19:43 -05:00 |
Disty0
|
9b579bfd96
|
Move quant functions to model_quant.py
|
2025-01-23 21:50:26 +03:00 |
Vladimir Mandic
|
5a7c1f50c1
|
add native torch fp8 storage dtype
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2025-01-23 12:07:08 -05:00 |
Disty0
|
e58b9b50e9
|
Don't force bnb version outside of cuda
|
2025-01-23 01:10:53 +03:00 |
Disty0
|
5d950a0164
|
Fix quanto logging with model offload
|
2024-12-30 16:44:07 +03:00 |
Vladimir Mandic
|
fd7fe8cea5
|
add torchao
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-17 13:29:36 -05:00 |
Vladimir Mandic
|
8f21e96f73
|
update bnb and increase ui timeouts
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-11 15:22:51 -05:00 |
Vladimir Mandic
|
944408e93b
|
warn on quanto with offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-12-10 10:39:13 -05:00 |
Vladimir Mandic
|
164ce252dc
|
add sd35 controlnets
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-11-28 08:46:10 -05:00 |
Vladimir Mandic
|
62c53942e0
|
post release jumbo patch
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-11-22 12:55:18 -05:00 |
Vladimir Mandic
|
168e9445d1
|
add bnb and quanto version info
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-11-11 16:16:22 -05:00 |
Vladimir Mandic
|
abfb197504
|
sd35 all-in-one safetensors support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-10-30 19:30:52 -04:00 |
Vladimir Mandic
|
7b150ba361
|
fix bnb loader
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-10-29 12:36:03 -04:00 |
Vladimir Mandic
|
58220b6497
|
flux enabled bnb quant on-the-fly
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-10-29 12:30:20 -04:00 |
Vladimir Mandic
|
6760632f38
|
major model load refactor
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-10-26 13:22:29 -04:00 |
Vladimir Mandic
|
f191134aa6
|
support bnb quantization during load
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-10-22 15:43:09 -04:00 |
Vladimir Mandic
|
ea0dfebe2d
|
better handle any quant lib requirements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
|
2024-10-12 13:36:16 -04:00 |