Commit Graph

376 Commits (1ebbaee7a3bc9a72a701d03ca4e75a0ba4e7873e)

Author SHA1 Message Date
kabachuha a790c248bd make weight parsing work 2023-04-13 18:39:31 +03:00
kabachuha cb5b9c438e
add inpainting weights to the args 2023-04-11 08:38:15 +03:00
kabachuha a26a8eebe8
add frame interpolater and weights keyframe 2023-04-11 08:03:45 +03:00
kabachuha 1b75f672a0 hide more debug info 2023-04-08 03:18:48 +03:00
kabachuha e5e13ef70f hide debug info 2023-04-08 03:14:01 +03:00
kabachuha ca54f0f8da better accordion location 2023-04-08 02:53:05 +03:00
kabachuha ecde517e57 fixup 2023-04-08 02:52:37 +03:00
kabachuha 0f498cff8c use accordion 2023-04-08 02:47:25 +03:00
kabachuha b8b4f14c55 Revert "tie do_inpainting to the tab selected"
This reverts commit a3f7a4afaa.
2023-04-08 02:43:11 +03:00
kabachuha 385e4237e6 Revert "shorten output settings to output"
This reverts commit b0efdb9dd5.
2023-04-08 02:43:08 +03:00
kabachuha b0efdb9dd5 shorten output settings to output 2023-04-08 02:39:55 +03:00
kabachuha a3f7a4afaa tie do_inpainting to the tab selected 2023-04-08 02:34:07 +03:00
kabachuha 82c1d571fc Update text2vid.py 2023-04-08 02:02:54 +03:00
kabachuha 7038b0ea65 Delete modelscope-text2vid.py 2023-04-07 22:34:19 +03:00
kabachuha ac76c6713c Merge branch 'main' into inpainting 2023-04-07 22:33:18 +03:00
kabachuha a4bfcefd9d fixup minor error on returns 2023-04-06 00:57:28 +03:00
kabachuha 1be6c566f0 fix video saving 2023-04-06 00:52:08 +03:00
kabachuha 2e5ea64021 fix noise device 2023-04-06 00:35:54 +03:00
kabachuha d75a22dce6 why are you even using importlib? 2023-04-06 00:33:17 +03:00
kabachuha 1d746927de vscode search has been lying to me again 2023-04-06 00:29:23 +03:00
kabachuha d6b654734f direct import fixup 2023-04-06 00:26:57 +03:00
kabachuha 59318d2a04 more import fixups 2023-04-06 00:25:00 +03:00
kabachuha 91f336b7a9 importlib import fixes 2023-04-06 00:22:28 +03:00
kabachuha d82bd88237 fix filename 2023-04-06 00:19:18 +03:00
kabachuha 5317b8647f import fixup 2023-04-06 00:15:55 +03:00
kabachuha f35fcb5a58 path 2023-04-06 00:14:11 +03:00
kabachuha eba061138b drop yaml import 2023-04-06 00:00:41 +03:00
kabachuha af80e0bdf2 add scripts subfolders to path 2023-04-05 23:58:07 +03:00
kabachuha de7429986d Update text2vid.py 2023-04-05 23:53:31 +03:00
kabachuha ddb6ac7c90 correct imports 2023-04-05 23:51:29 +03:00
kabachuha 2dca108a21 Update text2vid.py 2023-04-05 23:46:11 +03:00
kabachuha be3894c952 safe load for yaml 2023-04-05 23:44:09 +03:00
kabachuha 1042993fac os.getcwd name fixup 2023-04-05 23:40:27 +03:00
kabachuha e3b32ae463 use a generator for fixing seed 2023-04-05 23:38:19 +03:00
kabachuha 9eb3b19b02 fixup wording 2023-04-05 23:15:32 +03:00
kabachuha acaf07371b omegaconf import fixup 2023-04-05 23:11:32 +03:00
kabachuha c0e90a47aa added negative prompt support 2023-04-05 23:04:25 +03:00
kabachuha 93f53c059b base process 2023-04-05 22:57:11 +03:00
kabachuha dcc702249b update readme 2023-04-05 22:29:26 +03:00
kabachuha f16e62e663 GUI clarification 2023-04-05 22:21:29 +03:00
kabachuha 80bc5735bc fixup imports 2023-04-05 22:08:20 +03:00
kabachuha 828427b139 add videocrafter modules 2023-04-05 22:00:29 +03:00
hithereai d16dbf86c5 Merge remote-tracking branch 'upstream/main' into gradio_placeholders 2023-03-30 12:18:31 +03:00
kabachuha 6e2f2a816a use default values before opts are refreshed
closes #79 and closes #80
2023-03-28 16:23:42 +03:00
hithereai e8d7b6d2a0 final push 2023-03-28 00:08:53 +03:00
hithereai 56ac0a389c fixes, not final yet 2023-03-27 23:45:16 +03:00
hithereai 2a0c04297f some ui cleaning p1 2023-03-27 23:35:58 +03:00
Logan E 3b579f5e2d add custom weights field 2023-03-27 16:12:01 -04:00
hithereai 474bb3b15e quick fix 2023-03-27 22:48:50 +03:00
hithereai 438fb2cd49 del old commented line 2023-03-27 22:23:43 +03:00
hithereai 293a46c04f add webui settings, move vae and keep_in_vram to it 2023-03-27 22:18:40 +03:00
Logan E 84747cc527 inpainting, specify an initial frame and the video will be extrapolated from there 2023-03-27 08:58:48 -04:00
kabachuha a4644f073d fixed hotkeys after gradio update 2023-03-26 15:55:57 +03:00
kabachuha 2df3c600ca remove debug print 2023-03-26 15:46:05 +03:00
kabachuha 27de6c5564 lower the default cfg scale 2023-03-26 15:36:04 +03:00
kabachuha b8c2074345 the fix 2023-03-26 15:35:54 +03:00
kabachuha 0f6e79147c Update t2v_model.py 2023-03-26 15:05:24 +03:00
kabachuha 6b56afe3ff move debug 2023-03-26 14:46:47 +03:00
kabachuha 421c4d2a22 Update t2v_model.py 2023-03-26 14:33:19 +03:00
kabachuha 700dd1172e Update clip_hardcode.py 2023-03-26 14:27:35 +03:00
kabachuha 8f8a6690e4 Update t2v_model.py 2023-03-26 13:36:49 +03:00
kabachuha 56ef3128b7 Update clip_hardcode.py 2023-03-26 03:45:22 +03:00
kabachuha 0cb9bb8ea4 Update clip_hardcode.py 2023-03-26 03:38:50 +03:00
kabachuha 8894838535 change encode with transformers 2023-03-26 03:29:50 +03:00
kabachuha 0b834ac4ac Revert "test"
This reverts commit 868d95948b.
2023-03-26 03:20:43 +03:00
kabachuha 868d95948b test 2023-03-26 03:17:51 +03:00
kabachuha e38e6a23be fixup 2023-03-26 03:10:19 +03:00
kabachuha 682af52eac hardcode clip hijack 2023-03-26 03:06:59 +03:00
kabachuha b7fd24985f Update t2v_pipeline.py 2023-03-26 02:32:47 +03:00
kabachuha b1f928ae66 degauss the c 2023-03-26 02:28:38 +03:00
kabachuha 295a4905a8 more debug 2023-03-26 02:18:37 +03:00
kabachuha 2695215870 debug 2023-03-26 02:15:34 +03:00
kabachuha 0d96caa127 Revert "switch to internal clip"
This reverts commit 6585c22500.
2023-03-26 02:13:40 +03:00
kabachuha 0d915077a1 Revert "fixup"
This reverts commit 77e4c519b7.
2023-03-26 02:13:36 +03:00
kabachuha 9e1e191ac4 Revert "only reg learned conditioning"
This reverts commit b982c4dc4e.
2023-03-26 02:13:33 +03:00
kabachuha b982c4dc4e only reg learned conditioning 2023-03-26 02:05:39 +03:00
kabachuha 77e4c519b7 fixup 2023-03-26 01:55:41 +03:00
kabachuha 6585c22500 switch to internal clip 2023-03-26 01:53:39 +03:00
kabachuha d4e678fab8 Merge branch 'main' into prompt_weights 2023-03-26 00:59:37 +03:00
kabachuha d2c5e33c72 do not half model on mps 2023-03-26 00:52:20 +03:00
kabachuha fdf507c7e0 deduplicate torch_gc 2023-03-26 00:39:34 +03:00
kabachuha f532d344ac start clip on cpu, then bring to device correctly 2023-03-26 00:25:53 +03:00
kabachuha 63b901bca1 fix lines count 2023-03-26 00:15:05 +03:00
kabachuha 9383bb126e add check for cuda existance in gc runs 2023-03-26 00:00:08 +03:00
kabachuha a6eb86cdbe get_learning_conditioning inputs *list* of prompts
it may explain the wrong dimensions
2023-03-25 23:45:25 +03:00
kabachuha 2d523d380e default to cpu when macos
addresses #20
2023-03-25 23:23:55 +03:00
hithereai 6554d34149 fix vid2vid not working at all 2023-03-25 20:20:03 +03:00
kabachuha 0f9daba88b fix double generation and wrong strength
it was an error due to wrong merge conflict solving

sorry, guys

fix #62
2023-03-25 19:10:20 +03:00
hithereai 792f6f1ed6 un-break new gradio changes 2023-03-25 12:22:13 +03:00
kabachuha 9f9bd6577b set default denoising strength to 0.75 2023-03-25 01:49:32 +03:00
kabachuha 025ea30345 Update t2v_model.py 2023-03-24 23:46:42 +03:00
kabachuha 18d6a31369 Update t2v_model.py 2023-03-24 23:32:19 +03:00
kabachuha 442aa29a59 test 2023-03-24 23:26:53 +03:00
kabachuha dceaa53d5e Update t2v_pipeline.py 2023-03-24 23:17:43 +03:00
kabachuha d939d36672 Update t2v_pipeline.py 2023-03-24 23:10:28 +03:00
kabachuha 04fc68c07a more wrappers 2023-03-24 23:03:00 +03:00
hithereai 9f3a9b1e41 re-enable vid2vid strength 2023-03-24 22:56:33 +03:00
kabachuha 38311375d5 Update t2v_pipeline.py 2023-03-24 22:53:36 +03:00
kabachuha 628825d53f Update t2v_pipeline.py 2023-03-24 22:43:58 +03:00
kabachuha c19953e827 use webui's open clip wrapper 2023-03-24 22:38:01 +03:00
kabachuha a580579800 debug 2023-03-24 21:49:25 +03:00
kabachuha d073c2567d match c, uc shapes 2023-03-24 21:35:33 +03:00
kabachuha 1924681fa1 debig 2023-03-24 21:27:42 +03:00
kabachuha b579f0664f fixup 2023-03-24 21:14:19 +03:00
kabachuha faeb1befe4
multicond doesn't work with DDIM anyway 2023-03-24 18:46:17 +03:00
kabachuha 348e606bd9
no need to unsqueeze, since webui does it already 2023-03-24 18:25:40 +03:00
hithereai 77c39a5be2 fix prompt_parser error 2023-03-24 18:11:48 +03:00
kabachuha 01bdff3b62
fixup c and uc 2023-03-24 17:57:09 +03:00
kabachuha 6dea222d67
store very init timestring 2023-03-24 17:49:19 +03:00
kabachuha 300b157152
store init timestring 2023-03-24 17:46:19 +03:00
hithereai 7267065615 Merge remote-tracking branch 'upstream/main' into prompt_weights 2023-03-24 17:39:30 +03:00
hithereai f264199573 Merge remote-tracking branch 'upstream/main' into batch-count 2023-03-24 17:17:22 +03:00
kabachuha 18c59bcad8
unpack uc and c in correct auto1111 way 2023-03-24 13:43:51 +03:00
kabachuha faad0920fb
fixup strength x2 2023-03-24 10:54:13 +03:00
kabachuha 3ca4853fde
fixup default strength value 2023-03-24 10:52:36 +03:00
kabachuha eed681017a
typo fix 2023-03-24 10:08:17 +03:00
kabachuha 5f09fe761a add batch count to generate many vids in a row 2023-03-24 03:05:01 +03:00
kabachuha 208de7cea7 add shift+enter hotkey support 2023-03-24 02:43:10 +03:00
kabachuha 8956c19413 add hotkey weights editing support 2023-03-24 02:33:44 +03:00
kabachuha fde0e2502c add prompt weights 2023-03-24 02:24:25 +03:00
kabachuha 1b4f5b3e9e switch img2img steps to denoising strength slider 2023-03-24 00:09:24 +03:00
kabachuha b1b8b78298 option to use soundtrack from original video 2023-03-23 16:35:42 +03:00
kabachuha 1b0385a707 Update modelscope-text2vid.py 2023-03-23 16:24:12 +03:00
kabachuha c8e5146149 Update video_audio_utils.py 2023-03-23 16:18:53 +03:00
kabachuha bfeea0be8a fixup mkdir 2023-03-23 16:15:38 +03:00
kabachuha ec88f1e8b1 add ability to enter video paths 2023-03-23 16:08:57 +03:00
kabachuha 65228caf33 better message 2023-03-23 15:51:56 +03:00
kabachuha 9ed2223c09 re-add change seed to number 2023-03-23 15:46:39 +03:00
kabachuha 0c38ce35a8 shutil import fixup 2023-03-23 15:43:46 +03:00
kabachuha cfef316082 fix import 2023-03-23 15:33:04 +03:00
kabachuha 950f73a2ab fixup video utilities imports 2023-03-23 13:35:05 +03:00
hithereai 27a7abd220 another missing function added 2023-03-23 01:14:13 +02:00
hithereai 48bea06d55 add more missing code, not done 2023-03-23 01:12:50 +02:00
hithereai 1ba7c1b3f0 add missing code, functions and imports (ugly af) 2023-03-23 01:10:11 +02:00
hithereai 55b19a2315 fix old keep pipe param name 2023-03-23 00:54:24 +02:00
hithereai 6eb2ebdbdf add missing img2img_steps and img2img_startFrame 2023-03-23 00:52:33 +02:00
kabachuha c3ff752eca re-add get quick video info 2023-03-23 01:36:38 +03:00
kabachuha 39022a97a1 Merge branch 'main' into vid2vid-temp-branch 2023-03-23 01:36:19 +03:00
kabachuha a2c8b47186 fix file reference 2023-03-23 01:27:15 +03:00
kabachuha b7db19c046 fixup args count №2 2023-03-23 01:03:41 +03:00
kabachuha e75447e28e fixup args count 2023-03-23 00:27:26 +03:00
kabachuha 284b7cdd89 Load video from drag and drop 2023-03-23 00:22:34 +03:00
kabachuha 46b42c0240 Merge remote-tracking branch 'origin/origin/vid2vid-temp-branch' into vid2vid-temp-branch 2023-03-22 23:52:59 +03:00
hithereai b3b65e686d change seed to gr.Number in UI 2023-03-22 21:27:51 +02:00
kabachuha baa62e7e72 use seed = -1 as random 2023-03-22 21:46:26 +03:00
kabachuha 1329d372ec add a separate noise generator 2023-03-22 21:43:13 +03:00
kabachuha 4552baa0bf pass seed as arg 2023-03-22 21:36:42 +03:00
kabachuha 95b3a500a7 add vid2vid tab 2023-03-22 20:32:21 +03:00
Logan zoellner e7bd1045c2 fix bug and add vid2vid start frame 2023-03-22 12:27:55 -04:00
hithereai 447d012cf0 keep_pipe --> keep_pipe_in_vram renaming
First step in adding keep in RAM.
2023-03-22 18:27:02 +02:00
hithereai 58155f5160 All gr.rows to be type compact 2023-03-22 18:17:24 +02:00
hithereai 5501b6ca9d move ffmpeg related funcs to sep file 2023-03-22 18:14:22 +02:00
Logan f071b2c829
Merge branch 'main' into vid2vid 2023-03-22 07:40:06 -04:00
Logan zoellner e0a7ef35eb some cleanup for vid2vid 2023-03-22 07:35:43 -04:00
Miklos Nagy eabbfa1aeb Update t2v_pipeline.py 2023-03-22 12:29:41 +01:00
Logan zoellner b3cc0644de found the bug.. scale was being applied at wrong point 2023-03-22 07:20:55 -04:00
Logan zoellner 6b2919c105 vid2vid kind of working 2023-03-22 03:56:05 -04:00
Miklos Nagy 741e2b3da9 Better Chunks at decode + strength value
This PR makes chunk mechanism at decode effective, and exposes sampling strength for the init latent (0.0 defaults it None as originally)
2023-03-22 00:24:13 +01:00
kabachuha 1cf09f3109 cleanup pipe pr 2023-03-22 00:56:03 +03:00
kabachuha 6f8d9f487a fix VAE on CPU
fixes #25 and fixes #5
2023-03-21 23:51:09 +03:00
kabachuha e42e34dcf4 don't print that weird False message on start
since it doesn't really anything
2023-03-21 23:41:41 +03:00
hithereai 878ab3681a clean p2 2023-03-21 12:31:57 +02:00
hithereai 4d2e2c003b clean p1 2023-03-21 12:29:29 +02:00
Logan zoellner 1830b1f75e add option to keep pipe in memory 2023-03-21 04:41:23 -04:00
kabachuha ab1c4e744b support for more devices
including mps
2023-03-21 01:22:46 +03:00
kabachuha 340f3bab4b note about starring 2023-03-21 01:13:31 +03:00
kabachuha 5e79ae298f half vae
to lower vram usage and speedup processing
2023-03-21 00:21:22 +03:00
kabachuha b94911fd7e
Merge pull request #21 from sALTaccount/main
2x speedup
2023-03-20 23:47:11 +03:00
kabachuha 5055744d45 better wording 2023-03-20 23:37:39 +03:00
kabachuha 8dfc8597d0 better help layout
+ clarification on how to download config json
2023-03-20 23:33:44 +03:00
saltacc 10ab12bc8b
Remove uneccecary GC calls 2023-03-20 13:06:40 -07:00
kabachuha 92a71316d6 version getter 2023-03-20 17:40:23 +03:00
kabachuha acf7842789 hardcode error 2023-03-20 17:02:06 +03:00
kabachuha d89e69e63a path fix attempt 2 2023-03-20 16:49:18 +03:00
kabachuha c20285d16f hide the 'v i' row 2023-03-20 16:43:19 +03:00
kabachuha c4089e6e16 fixup path separators for error.mp4 2023-03-20 16:40:39 +03:00
kabachuha e22936c29c tqdm for sampling 2023-03-20 16:24:41 +03:00
kabachuha fe853afe2c fixup hijack if model is already None 2023-03-20 16:24:08 +03:00
kabachuha b037dab4c8 move dataurl before the try catch 2023-03-20 16:17:35 +03:00
kabachuha 4a9b160f66 test 2023-03-20 15:42:20 +03:00
kabachuha 2a19cbc62d tiny ui impr 2023-03-20 15:37:39 +03:00
kabachuha 8919ed8840 good ol' show video button 2023-03-20 15:35:05 +03:00
kabachuha 692eae99b2 better note 2023-03-20 15:28:12 +03:00
kabachuha 0c7afa963f use html with dataurl instead of gr video 2023-03-20 15:25:08 +03:00
kabachuha 074272b7e1 try removing extra outputs 2023-03-20 15:16:22 +03:00
kabachuha 67209c0ec7 add error placeholder vid 2023-03-20 15:11:41 +03:00
kabachuha 71f910a5e3 better links 2023-03-20 14:52:53 +03:00
kabachuha ba8fb9278f add formatting to outdir 2023-03-20 14:48:11 +03:00
kabachuha 9f638304f7 max frames value seems to be 125 2023-03-20 14:42:22 +03:00
kabachuha 69de30b3df fix ffmpeg path determination 2023-03-20 14:42:09 +03:00
kabachuha 6276b274c8 more ffmpeg fixes 2023-03-20 14:38:23 +03:00
kabachuha fc792da15e fixup stitching 2023-03-20 14:30:03 +03:00
kabachuha 5e8fe9ccb0 create vid along frames 2023-03-20 14:28:06 +03:00
kabachuha 8c245ff824 fixup soundtrack path 2023-03-20 14:22:31 +03:00
kabachuha 63cf715c88 better default values 2023-03-20 14:22:19 +03:00
kabachuha cb9e0ba24b fix sd unloading
closes #7
2023-03-20 14:18:48 +03:00
kabachuha 2292ac1c49 more clean ui 2023-03-20 14:10:17 +03:00
kabachuha 9a45c78d12
fixup imports 2023-03-20 14:02:07 +03:00
kabachuha f168f92351
add the rest of args to ffmpeg 2023-03-20 13:34:26 +03:00
kabachuha 3f036e4cac
pass some args to ffmpeg 2023-03-20 13:27:55 +03:00