Commit Graph

8 Commits (cfcfa4e4d28dcce91eb029c8a70d01042161403f)

Author SHA1 Message Date
Vladimir Mandic 0f595d4cc5 cleanup multiple model loaders
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-11 22:16:05 -04:00
Vladimir Mandic b5031a5eba lora modularize code
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-04-01 13:39:47 -04:00
Vladimir Mandic 5ce834c362 fix missing quant options
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-03-28 14:50:37 -04:00
Vladimir Mandic f4fdd496b9 more granular quantization modules options
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-03-28 14:46:52 -04:00
Vladimir Mandic 4f56f4aa33 add new optimum-quanto on-the-fly and simplify quantization loading
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-03-16 21:45:05 -04:00
Vladimir Mandic a7ccea60ff add lumina2
Signed-off-by: Vladimir Mandic <mandic00@live.com>
2025-02-12 08:54:00 -05:00
Vladimir Mandic a6cf31b873 zero token counter when using large encoder models 2024-07-06 09:33:45 -04:00
Vladimir Mandic 32dc4b3ab4 draft lumina work 2024-07-05 20:06:06 -04:00