275 lines
19 KiB
Markdown
275 lines
19 KiB
Markdown
|
|
|
|
|
|
---
|
|
# One Button Prompt
|
|
|
|
# Summary
|
|
|
|
One Button Prompt is a tool/script for Automatic1111/ComfyUI/RuinedFooocus for beginners who have problems writing a good prompt, or advanced users who want to get inspired.
|
|
|
|
It generates an entire prompt from scratch. It is random, but controlled. You simply load up the script and press generate, and let it surprise you.
|
|
|
|
It is a full AI prompt generator for Stable Diffusion.
|
|
|
|
It is best used on all-purpose models, such as Stable Difussion 1.5 or those based on 1.5. It also works great on SDXL. Models such as [deliberate](https://civitai.com/models/4823/deliberate) and [dreamlike diffusion](https://civitai.com/models/1274/dreamlike-diffusion-10). However, feel free to use it on your personal favorite models.
|
|
|
|
A simple user guide for first time use and settings is available [here](https://github.com/AIrjen/OneButtonPrompt/blob/main/user_guides/my_first_generation.md).
|
|
|
|
It is also now available as a custom node for ComfyUI. [Check installation doc here](https://github.com/AIrjen/OneButtonPrompt/blob/main/user_guides/comfyui_integration.md)
|
|
|
|
More of a Fooocus fan? Take a look at this excellent fork called [RuinedFooocus](https://github.com/runew0lf/RuinedFooocus) that has One Button Prompt built in. [Check some options available here](https://github.com/AIrjen/OneButtonPrompt/blob/main/user_guides/ruinedfooocus_integration.md)
|
|
|
|
# Features
|
|
- __Full prompt generation__ with the click of a button. ==> [guide to my first generation](https://github.com/AIrjen/OneButtonPrompt/blob/main/user_guides/my_first_generation.md)
|
|
- Supports __TXT2IMG, IMG2IMG, ControlNET, inpainting and latent couple__. ==> [guide to IMG2IMG and ControlNET](https://github.com/AIrjen/OneButtonPrompt/blob/main/user_guides/the_next_generation_img2img_and_controlnet.md)
|
|
- Save your favorite generation settings with __presets__. ==> [One Button Presets](https://github.com/AIrjen/OneButtonPrompt/blob/main/user_guides/one_butten_presets.md)
|
|
- __Workflow assist__, generate multiple prompts with One Button. Create __prompt variants__ with ease. ==> [guide to workflow assist and prompt variant mode](workflow_assist_and_prompt_variant_mode.md)
|
|
- Create __infinite variations__ of a __chosen subject__. ==> [guide to override subject](https://github.com/AIrjen/OneButtonPrompt/blob/main/user_guides/override_subject_and_infinite_variations.md)
|
|
- Fully __automated generation, classification and upscaling__. ==> [guide to one_button_run_and_upscale](https://github.com/AIrjen/OneButtonPrompt/blob/main/user_guides/one_button_run_and_upscale.md)
|
|
- Add __LoRA's__, customize lists and personal artists choices. ==> [guide to custom files](https://github.com/AIrjen/OneButtonPrompt/blob/main/user_guides/custom_files.md)
|
|
- __Compound__ multiple prompts together for unexpected results. ==> [guide to prompt compounder](https://github.com/AIrjen/OneButtonPrompt/blob/main/user_guides/prompt_compounder_and_regional_prompter_to_create_insane_images.md)
|
|
- Use __wildcards__, or __combine with Dynamic Prompts__ extension ==> [guide to using wildcards and Dynamic Prompts](https://github.com/AIrjen/OneButtonPrompt/blob/main/user_guides/wildcards_and_dynamic_prompts_extension.md)
|
|
- Has a set of __template prompts__ from various sources, __fully wildcarded__ and usable with Subject Override ==> [guide to prompt templates](https://github.com/AIrjen/OneButtonPrompt/blob/main/user_guides/templates.md)
|
|
- Has multiple __prompt generation modes__ to choose from ==> [guide to prompt generation modes](https://github.com/AIrjen/OneButtonPrompt/blob/main/user_guides/prompt_generation_modes.md)
|
|
- Stay in control, and fine-tune One Button Prompt with a __config__ file ==> [config file](https://github.com/AIrjen/OneButtonPrompt/blob/main/user_guides/config_file.md)
|
|
- __Flufferize__ your prompt to enhance your results with Prompt Magic
|
|
|
|
## Important Notice
|
|
|
|
One Button Prompt had a recent large change in the UI when Presets were introduced. This might be confusing for long time users.
|
|
|
|
If you are not finding the settings, change the __"One Button Preset"__ to __"Custom..."__.
|
|
|
|
<img src="https://github.com/AIrjen/OneButtonPrompt/assets/130234949/6d821c82-edf9-4496-867f-ac01dda994cd.png" width="50%" height="50%">
|
|
|
|
## How to use in automatic1111/SD.next
|
|
In TXT2IMG or IMG2IMG, select the script "One Button Prompt".
|
|
|
|
<img src="https://github.com/AIrjen/OneButtonPrompt/assets/130234949/b43f7bef-533d-4139-a477-562a0b2d39ca.png" width="50%" height="50%">
|
|
|
|
Leave the prompts empty:
|
|
|
|
<img src="https://user-images.githubusercontent.com/130234949/230793068-d38bc782-4c2f-4268-9e91-76f4eabe3eca.png" alt="who needs prompts anyway" width="50%" height="50%">
|
|
|
|
Hit Generate!
|
|
|
|
<img src="https://user-images.githubusercontent.com/130234949/230793086-cedbe72a-e1eb-46e5-a425-4a52540847f6.png" alt="click!" width="30%" height="30%">
|
|
|
|
Enjoy creating awesome pictures:
|
|
|
|
|
|
> Concept art, Fluid Biosphere, at Dawn, F/1.8, Kodak portra, extremely beautiful ,
|
|
|
|
Please be aware, that not each picture will be awesome due to the randomness of the prompt, artist and model used.
|
|
You might get an epic landscape, or a photo of an Aggregavated Trout. In my experience, about 1 in 5 is good. Everyone of them is interesting.
|
|
|
|
Don't get overwhelmed by the options, they will become more clear once you use it more.
|
|
|
|
For first time users, play around with the set presets.
|
|
|
|
Some more examples below. And check the first time user guide [here](https://github.com/AIrjen/OneButtonPrompt/blob/main/user_guides/my_first_generation.md).
|
|
|
|
### Some details
|
|
It will generate between 0 and 3 artists, and add those the prompt.
|
|
|
|
It can generate the following subjects, while building a prompt:
|
|
|
|
1. object - Can be a random object, a building ,a vehicle, some food or objects from space.
|
|
|
|
2. animal - A random (fictional) animal. Has a chance to have human characteristics, such as clothing added.
|
|
|
|
3. humanoid - A random humanoid, males, females, fantasy types, fictional and non-fictional characters. Can add clothing, features and a bunch of other things.
|
|
|
|
4. landscape - A landscape or a landscape with a building.
|
|
|
|
5. concept - Can be a concept, such as "the X of Y", or an historical event such as "The Trojan War". It can also do a line from a poem or from a song.
|
|
|
|
It mixes techniques such as prompt switching and hybrids.
|
|
|
|
This generator will generate a complete full prompt for you, based on randomness. You can increase the slider, to include more things to put into the prompt.
|
|
Recommended is keeping it around 3-7. Use 10 at your own risk.
|
|
|
|
There are a lot of special things build in, based on various research. Just try it, and let it surprise you.
|
|
|
|
Suggestion is to leave the prompt field empty, anything here will be added at the end of the generated prompt.
|
|
It doesn't add anything to the negative prompt field, so feel free to add your favorite negative prompts here.
|
|
|
|
For each Batch you run, it will create a new prompt. For each batch size, it will reuse the same prompt.
|
|
|
|
|
|
# Installing in automatic1111
|
|
One Button Prompt can be found in the normal installation list of Automatic1111. Go to Extension -> Available and press Load From. In the list you will see One Button Prompt, and press install.
|
|
|
|
|
|
|
|
If you want to do it manually,sSimply install this from via install from URL. After that you can see OneButtonPrompt in the script fields for txt2img and img2img.
|
|
Set the following URL to install from: https://github.com/AIrjen/OneButtonPrompt
|
|
|
|
<img src="https://user-images.githubusercontent.com/130234949/230917712-60a3c1f4-fea6-4ecd-bc68-da52f1ff86fe.png" alt="Easy to install" width="50%" height="50%">
|
|
|
|
You can also download the files from github directly, and place them under your automatic1111 installation in the \Extensions\ folder.
|
|
|
|
# Main tab
|
|
|
|
The main tab will show preset options, which are preset generation settings which will help achieve good results. On default, it is set to __Standard__, which was the previous default setting of One Button Prompt. It is quite random and give some wild results.
|
|
|
|
If you are looking for more guided results, choose a different preset. Some good first choices are:
|
|
|
|
- Standard -> One Button Prompts default. Wild and unpredictable. Good for prompt exploration.
|
|
- Unique People Portraits -> Will focus on generating photographic people
|
|
- D&D Style Portraits -> Will focus on generating fantasy style portraits
|
|
- Consistent Results -> Running on a large set of build in styles, to get consistent results in prompts. Works best on SDXL.
|
|
- Greg Mode - The Preset -> Focusses on creating characters, mixed with popular artists (like Greg Rutkowski). Works best on SD 1.5 models.
|
|
|
|
|
|
If you want to change the settings yourself, please change the One Button Preset to __"Custom..."__. This will load in all the settings to be adjusted.
|
|
|
|
|
|
Insanity level. You can increase the slider, to include more things to put into the prompt. Recommended is keeping it around 3-7. Use 10 at your own risk. I usually run it between 5 and 7.
|
|
|
|
You an use the Subject Types filter to select on main subject types to generate. Maybe you want only Landscapes, maybe you want only people. Select it here.
|
|
|
|
Artists have a major impact on the result. Automatically, it will select between 0-3 artists out of 3483 artists for your prompt.
|
|
You can turn it off. Add your own artists to the prompt, and they will be added to the end of the prompt.
|
|
|
|
Type of image can be used to force a certain direction. For example when using Realistic Vision, it might be a good idea to set it to photograph. For an anime model, you might want to use "Anime key visual"
|
|
|
|
Special image type modes have chance to trigger. Those follow different rules of prompt generation.
|
|
|
|
When you fill in the Overwrite subject field, that subject will be used to build the dynamic prompt around. It is best, if you set the subject type to match the subject. For example, set it to humanoid if you place a person in the override subject field.
|
|
|
|
This way, you can create unlimited variants of a subject.
|
|
|
|
Smart subject tries to determine what to and not to generate based on your subject. Example, if your Overwrite subject is formed like this: Obese man wearing a kimono.
|
|
It will then recognize the body type and not generate it. It also recognizes the keyword wearing, and will not generate an outfit.
|
|
|
|
The existing prompt and negative prompt fields are ignored.
|
|
|
|
Add a prompt prefix, suffix and the negative prompt in the respective fields. They will be automatically added during processing.
|
|
|
|
These can be used to add textual inversion and LoRA's. They can also be used to add your models trigger words.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
# Workflow assist tab
|
|
This tab is designed to help with the workflow of adjusting and maintaining prompts without turning the extension off.
|
|
"Workflow mode" turns off the generated script, and uses the Workflow prompt instead.
|
|
|
|
Use the prompt variant slider to create variants of the Workflow prompt.
|
|
|
|
It also has the options to generate a few prompts with a click and send them to the workflow prompt. This way you can search or combine interesting ideas together.
|
|
|
|
|
|
|
|
# One Button Run and Upscale
|
|
Using the API feature of WebUI, this allows you to:
|
|
|
|
This will allow you to:
|
|
1. Generate an image with TXT2IMG
|
|
1. Can enable Hi res. fix
|
|
2. Possible to set up a __Quality Gate__, so only the best images get upscaled
|
|
3. Possible to ignore the One Button Prompt generation, and __use your own prompts__
|
|
2. Upscale that image with IMG2IMG
|
|
1. This proces can be repeated. Loopback enabled.
|
|
2. Supports __SD Upscale__, __Ultimate SD Upscale__ and __Controlnet tile_resample__ methods of upscaling
|
|
3. Upscale with EXTRAS
|
|
4. Possiblities for __just upscale__ existing images
|
|
|
|
All with a single press of __One Button__.
|
|
|
|
[User Guide here!](https://github.com/AIrjen/OneButtonPrompt/blob/main/user_guides/one_button_run_and_upscale.md#one-button-run-and-upscale)
|
|
|
|
|
|
|
|
# roadmap
|
|
Some ideas I'd like to implement:
|
|
- Ongoing: list refinements and new features in the prompt generation
|
|
- Ongoing: Documentation and toturials
|
|
|
|
If you have a good idea or suggestion, let me know, or build it yourself ;)
|
|
|
|
# prompts and examples
|
|
From the above header, these are the generated prompts, from left to right, top to bottom. Generated during various stages of development. Using deliberate and DPM Karras.
|
|
|
|
>cinematic shot of a Cruel " The Soul of Enlightenment ", at Blue hour, Cel shaded
|
|
|
|
>( art by Albert Dubois-Pillet :0.9), art by Bastien Lecouffe-Deharme, Physically based render, Tranquil Delicate Island and Windmill, at Golden hour, Illustration, Amusing, Fish-eye Lens
|
|
|
|
>art by Aykut Aydogdu,art by Jacob van Ruisdael, 3D Rendering, extreme wide shot of a Wraith, Crusader ,wearing Floral maxi dress and sandals, background is Strait, Illustration, Modern European Ink Painting, loop lighting, octane engine
|
|
|
|
>art by Gaston Bussière, Photograph, Cottage Progressive Era Tokyo, Orange and Pink hue
|
|
|
|
>art by Jeffrey T. Larson, Tired Illuminating The Misty Mountains and The River Styx, at Dusk, Vaporwave Art, Rembrandt lighting
|
|
|
|
>art by Jon Foster,art by Ricardo Bofill, extreme wide shot of a " The Industrial Revolution ", background is Appalachian, tilt shift, New Wave Art, Mono Color
|
|
|
|
|
|
|
|
>( art by Peter Saville :0.7), Layered paper art of a Irritated Airy Blueberry, Screen print, hair light, Depth of field 270mm, Kinemacolor
|
|
|
|
>( art by Jessie Arms Botke :1.1), ( art by Juan Carreño de Miranda :1.2), ( art by Cerith Wyn Evans :1.2), [ birds-eye-view shot of a Belle Époque portly Tyra Banks cosplaying as Spider-Man, Hosting parties ,wearing Industrial Turquoise Gator skin Tank top and denim skirt, Black hair styled as Space buns, Scarf, background is The Gobi Desert, at Starry night, split diopter, Realistic, Autochrome ::8]
|
|
|
|
>art by Art Spiegelman, Unsightly The Badwater Basin and Stonehenge, Sunny, Ultrarealistic, Psytrance Art, Mono Color
|
|
|
|
>art by Gerhard Munthe, Long shot of a Classical midweight Asian Chris Hemsworth riding a Koala, Brown hair styled as Short and messy, background is The Palace of Asgard, natural lighting, Low shutter, Film Washi
|
|
|
|
>art by Peter Eisenman, Vector Art, Serene The Garden of Eden, Stormy weather, Movie still, Peaceful
|
|
|
|
>( art by Hans Zatzka :1.3), Aquatint of a Compelling Dubrovnik, at Sunrise, Illustration, Orientalism Art, Black lighting, overhead angle
|
|
|
|
|
|
>art by Guillem H. Pongiluppi, F/1.8 of a " The life of Saint Barbara of Nicomedia ", at Starry night, shallow depth of field, Movie still, Frightening
|
|
|
|
>art by Jeffrey Smith, close-up shot of a Victorian Bulgarian Kitchen timer, background is The Grand Canyon of the Yellowstone, Spring, Sketch, Peaceful, natural lighting, Calotype
|
|
|
|
>art by Helen Allingham,art by Étienne Maurice Falconet, Water color painting, Circular polarizer of a Mayan Revival Dominican Female Dragon rider, Auburn hair styled as Messy bun, at Sunrise, deep focus, Sad
|
|
|
|
>art by Sparth , Spanish Golden Age Tranquil The Angel Oak and Liverpool , Foggy conditions , Screen print , Ukiyo-E , Provia
|
|
|
|
>by artist Michael Craig-Martin, by artist John Lurie, Zoon lens of a Rustic Fatigued portly Blue Jay, background is Indonesia, Relieving, Mono Color
|
|
|
|
>by artist Brandon Mably, Vector Art, extreme wide shot of a Aggravated Invigorating Fijian snake at Stormy weather, FOV 90 degrees, Vaporwave Art, flat lighting, High Contrast
|
|
|
|
|
|
# More prompts and examples
|
|
|
|
|
|
> (art by Daniel Lieske:1.3), Spray paint style, Noble Rustic The Hanging Gardens of Babylon and Cafe, at Dusk, Masterpiece, Shameful, Academism, Lens Flare, Fujifilm Superia, UHD
|
|
|
|
|
|
> [art by Max Bedulenko| art by Jack Davis], Spray paint style, Vile Mecha Spit, at Starry night, F/5, psychedelic colors, 8K
|
|
|
|
|
|
>close-up shot of a Cozy Falcon, Summer, Bokeh, Sketch, Lonely, Pop Art, Black lighting, Fish-eye Lens, Calotype, Magic the gathering, layered textures, [(art by Yasushi Nirasawa :0.8),(art by Rumiko Takahashi :1.3), art by Carl Barks :7],
|
|
|
|
|
|
> [(art by Walter Quirt :1.2):(art by Arthur Dove :1.0):8], Renderman, Hideous The Eyrie of House Arryn and Imp-drawn carriage, at Starry night, Detailed illustration, Bloom light, 80mm, Film grain
|
|
|
|
|
|
|
|
> by artist Sam Spratt, by artist Robert Hagan, by artist Mike Kelley, Painting, landscape, wide shot of Cavern, Screen print, Lonely, Neo-Fauvism
|
|
|
|
|
|
> Vector Art, high angle shot of a Dreadful Anime "The Fukushima Disaster", Disgusting, Methaphysical painting, studio lighting, F/5, Mono Color, behance, [(art by Hans Zatzka :1.1),(art by Alexandre Jacovleff :1.0)::13], ,
|
|
|
|
|
|
> Long exposure of a Ignorant Light Klingon cosplaying as Princes Leia Organa, with Pink skin, Sitting with elbows on knees, Gloves, background is Landfill, at Nighttime, Happy, Grayscale, extremely detailed CG Unity 8k wallpaper, (art by Paul Hedley:1.1), art by Giacomo Balla , (art by Andre Norton:1.1)
|
|
|
|
|
|
> art by Marianne North, Cozy Botanical garden and South-American The Alhambra, Thunderstorm, Detailed illustration, Private Press, Light caustics, Circular polarizer, Swirling Polyester, Light streaks, absurdres, trending on artstation
|
|
|
|
# Thank you
|
|
Thank you to the amazing [Stylepile](https://github.com/some9000/StylePile) and [Dynamic Prompts](https://github.com/adieyal/sd-dynamic-prompts) for inspiration.
|
|
|
|
Thanks to everyone maintaining this [SD artists list](https://docs.google.com/spreadsheets/d/14xTqtuV3BuKDNhLotB_d1aFlBGnDJOY0BRXJ8-86GpA/edit#gid=0)
|
|
|
|
Thanks to openart.ai for setting up the very helpful [prompt book](https://openart.ai/promptbook)
|
|
|
|
Thanks to this [ai art modifier guide](https://www.the-ai-art.com/modifiers)
|
|
|
|
Everyone at the [stable diffusion subreddit](https://www.reddit.com/r/StableDiffusion/) for inspiration and sharing workflows
|