1580158
/
sd-3dmodel-loader
mirror of https://github.com/jtydhr88/sd-3dmodel-loader.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
Load your 3D model/animation inside webui, or edit model pose as well, then send screenshot to txt2img or img2img to ControlNet.
129 Commits
1 Branch
0 Tags
108 MiB
JavaScript 99.6%
Python 0.3%
 
 
Go to file
Terry Jia 3605e2168f openpose view and download openpose json 2023-09-11 21:34:39 -04:00
doc add gesture lib 2023-09-08 21:13:22 -04:00
javascript add gesture lib 2023-09-08 21:13:22 -04:00
js openpose view and download openpose json 2023-09-11 21:34:39 -04:00
models fix #62 load pose error 2023-09-11 17:33:39 -04:00
poses pose lib support 2023-04-02 21:39:07 -04:00
public scene panel - use this panel to control objs on scene, and combine other panels like Canvas and Camera 2023-04-30 21:48:25 -04:00
scripts support multi language 2023-09-05 17:06:38 -04:00
src openpose view and download openpose json 2023-09-11 21:34:39 -04:00
.gitignore refactor this extension by using React 2023-04-25 10:34:57 +08:00
LICENSE add License 2023-03-09 22:26:12 -05:00
README.md Merge remote-tracking branch 'origin/master' 2023-09-08 21:14:25 -04:00
index.html refactor this extension by using React 2023-04-25 10:34:57 +08:00
package.json support multi language 2023-09-05 17:06:38 -04:00
style.css style fix - ul 2023-05-03 22:28:17 -04:00
webpack.config.js refactor this extension by using React 2023-04-25 10:34:57 +08:00

README.md

Stable Diffusion WebUI 3D Model&Pose Loader

A custom extension for AUTOMATIC1111/stable-diffusion-webui that allows you to load your local 3D model/animation inside webui, or edit pose as well, then send screenshot to txt2img or img2img as your ControlNet's reference image.
1.png controlnet.png

Installation

Just like you install other extension of webui:

  1. go to Extensions -> Install from URL
  2. paste this repo link
  3. install
  4. go to Installed, apply and restart UI

Or you can install from Extensions -> Available, and load the official extension link, then you can find this extension on the list. installFromOfficialLink.png

Quick Start

  1. click Load Model button, select one model from your local, check here for support formats,
  2. or click Load Hand Model/Load Body Model to load embedded hand/body model.
  3. On the main canvas, you can use:
    1. Mouse left button -> rotate the camera
    2. Mouse wheel -> zoom in or out
    3. Mouse right button -> move the camera
  4. Send the screenshot to ControlNet

More Details and features

Gradio.Model3D?

I know gradio has its own 3D model component called Gradio.Model3D, but it only supports three formats: obj, glb and gltf, I think it is not enough, at least it should support FBX animation, so I build my own extension.

Credits

Created by jtydhr88 and special thanks to other contributors:

My other extension for Stable diffusion webui

  • Canvas Editor A custom extension for AUTOMATIC1111/stable-diffusion-webui that integrated a full capability canvas editor which you can use layer, text, image, elements and so on, then send to ControlNet, basing on Polotno.
  • StableStudio Adapter A custom extension for AUTOMATIC1111/stable-diffusion-webui to extend rest APIs to do some local operations, using in StableStudio.
  • Txt/Img to 3D Model A custom extension for sd-webui that allow you to generate 3D model from txt or image, basing on OpenAI Shap-E.
  • 3D Editor A custom extension for sd-webui that with 3D modeling features (add/edit basic elements, load your custom model, modify scene and so on), then send screenshot to txt2img or img2img as your ControlNet's reference image, basing on ThreeJS editor.