Commit Graph

121 Commits (39ce3d7ea31b0ba51a861298a0a3ffa6607f8a2f)

Author SHA1 Message Date
Vladimir Mandic a5d3a68107 add cogview4
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-03-15 13:20:17 -04:00
Vladimir Mandic 49712ab9e7 update requirements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-02-13 12:03:08 -05:00
Vladimir Mandic a7ccea60ff add lumina2
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-02-12 08:54:00 -05:00
Vladimir Mandic 61a98b0b7b fix bnb version
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-02-01 16:09:31 -05:00
Vladimir Mandic 06ba03cf80 settings option to disable reference models
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-23 15:19:43 -05:00
Disty0 9b579bfd96 Move quant functions to model_quant.py 2025-01-23 21:50:26 +03:00
Vladimir Mandic 5a7c1f50c1 add native torch fp8 storage dtype
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-01-23 12:07:08 -05:00
Disty0 e58b9b50e9 Don't force bnb version outside of cuda 2025-01-23 01:10:53 +03:00
Disty0 5d950a0164 Fix quanto logging with model offload 2024-12-30 16:44:07 +03:00
Vladimir Mandic fd7fe8cea5 add torchao
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-17 13:29:36 -05:00
Vladimir Mandic 8f21e96f73 update bnb and increase ui timeouts
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-11 15:22:51 -05:00
Vladimir Mandic 944408e93b warn on quanto with offload
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-12-10 10:39:13 -05:00
Vladimir Mandic 164ce252dc add sd35 controlnets
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-28 08:46:10 -05:00
Vladimir Mandic 62c53942e0 post release jumbo patch
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-22 12:55:18 -05:00
Vladimir Mandic 168e9445d1 add bnb and quanto version info
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-11-11 16:16:22 -05:00
Vladimir Mandic abfb197504 sd35 all-in-one safetensors support
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-30 19:30:52 -04:00
Vladimir Mandic 7b150ba361 fix bnb loader
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-29 12:36:03 -04:00
Vladimir Mandic 58220b6497 flux enabled bnb quant on-the-fly
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-29 12:30:20 -04:00
Vladimir Mandic 6760632f38 major model load refactor
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-26 13:22:29 -04:00
Vladimir Mandic f191134aa6 support bnb quantization during load
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-22 15:43:09 -04:00
Vladimir Mandic ea0dfebe2d better handle any quant lib requirements
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2024-10-12 13:36:16 -04:00