update readme

pull/48/head
s9roll7 2023-03-11 20:56:13 +09:00
parent 644fb2a5ab
commit f15502b822
6 changed files with 39 additions and 4 deletions

View File

@ -43,6 +43,7 @@
[Here](sample/) is the actual configuration file used. placed in "Project directory" for use.
<div><video controls src="https://user-images.githubusercontent.com/118420657/218247633-ab2b1e6b-d81c-4f1d-af8a-6a97df23be0e.mp4" muted="false"></video></div>
<br>
## Installation
- Install [ffmpeg](https://ffmpeg.org/) for your operating system
@ -50,6 +51,9 @@
- Install [Ebsynth](https://ebsynth.com/)
- Use the Extensions tab of the webui to [Install from URL]
<br>
<br>
## Usage
- Go to [Ebsynth Utility] tab.
- Create an empty directory somewhere, and fill in the "Project directory" field.
@ -60,7 +64,10 @@
Progress during the process is not reflected in webui, so please check the console screen.
If you see "completed." in webui, it is completed.
(In the current latest webui, it seems to cause an error if you do not drop the image on the main screen of img2img.
Please drop the image as it does not affect the result.)
Please drop the image as it does not affect the result.)
<br>
<br>
## Note 1
For reference, here's what I did when I edited a 1280x720 30fps 15sec video based on
@ -89,7 +96,7 @@ Here is the settings I used.
Here is the settings for extension.
- Mask Mode(Override img2img Mask mode) : Normal
- Img2Img Repeat Count : 5
- Img2Img Repeat Count (Loop Back) : 5
- Add N to seed when repeating : 1
- use Face Crop img2img : True
- Face Detection Method : YuNet
@ -108,6 +115,14 @@ If you have lots of memory to spare, increasing the width and height values whil
This extension may help with the adjustment.
https://github.com/s9roll7/img2img_for_all_method
<br>
**The information above is from a time when there was no controlnet.
When controlnet are used together (especially multi-controlnets),
Even setting "Denoising strength" to a high value works well, and even setting it to 1.0 produces meaningful results.
If "Denoising strength" is set to a high value, "Loop Back" can be set to 1.**
<br>
#### Stage 4
Scale it up or down and process it to exactly the same size as the original video.
@ -137,7 +152,27 @@ In my case, the entire process from 1 to 7 took about 30 minutes.
- Crossfade blend rate : 1.0
- Export type : mp4
## Note 2 : How to use clipseg
<br>
<br>
## Note 2 : How to use multi-controlnet together
#### in webui setting
![controlnet_setting](imgs/controlnet_setting.png "controlnet_setting")
<br>
#### In controlnet settings in img2img tab(for controlnet 0)
![controlnet_0](imgs/controlnet_0.png "controlnet_0")
<br>
#### In controlnet settings in img2img tab(for controlnet 1)
![controlnet_1](imgs/controlnet_1.png "controlnet_1")
<br>
#### In ebsynth_utility settings in img2img tab
**Warning : "Weight" in the controlnet settings is overridden by the following values**
![controlnet_option_in_ebsynthutil](imgs/controlnet_option_in_ebsynthutil.png "controlnet_option_in_ebsynthutil")
<br>
<br>
## Note 3 : How to use clipseg
![clipseg](imgs/clipseg.png "How to use clipseg")

View File

@ -106,7 +106,7 @@ def ebsynth_utility_process(stage_index: int, project_dir:str, original_movie_pa
dbg.print("5. I recommend to fill in the \"Width\" field with [" + str(img_width) + "]" )
dbg.print("6. I recommend to fill in the \"Height\" field with [" + str(img_height) + "]" )
dbg.print("7. I recommend to fill in the \"Denoising strength\" field with lower than 0.35" )
dbg.print(" (It's okay to put a Large value in \"Face Denoising Strength\")")
dbg.print(" (When using controlnet together, you can put in large values (even 1.0 is possible).)")
dbg.print("8. Fill in the remaining configuration fields of img2img. No image and mask settings are required.")
dbg.print("9. Drop any image onto the img2img main screen. This is necessary to avoid errors, but does not affect the results of img2img.")
dbg.print("10. Generate")

BIN
imgs/controlnet_0.png Normal file

Binary file not shown.

After

Width:  |  Height:  |  Size: 39 KiB

BIN
imgs/controlnet_1.png Normal file

Binary file not shown.

After

Width:  |  Height:  |  Size: 42 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 62 KiB

BIN
imgs/controlnet_setting.png Normal file

Binary file not shown.

After

Width:  |  Height:  |  Size: 90 KiB