automatic/TODO.md

4.5 KiB

TODO

Project Board

Kanvas

  • server-side mask handling vs ui mask handling
  • outpaint visible image edge seam

Internal

  • UI: New inpaint/outpaint interface
    Kanvas
  • Deploy: Create executable for SD.Next
  • Feature: Integrate natural language imagesearch
    ImageDB
  • Feature: Transformers unified cache handler
  • Feature: Remote Text-Encoder support
  • Refactor: Modular pipelines and guiders
  • Refactor: move sampler options to settings to config
  • Refactor: GGUF
  • Feature: LoRA add OMI format support for SD35/FLUX.1
  • Refactor: remove CodeFormer
  • Refactor: remove GFPGAN
  • UI: Lite vs Expert mode
  • Video tab: add full API support
  • Control tab: add overrides handling
  • Engine: TensorRT acceleration

Features

New models / Pipelines

TODO: Prioritize!

Code TODO

npm run todo

  • control: support scripts via api
  • fc: autodetect distilled based on model
  • fc: autodetect tensor format based on model
  • hypertile: vae breaks when using non-standard sizes
  • install: switch to pytorch source when it becomes available
  • loader: load receipe
  • loader: save receipe
  • lora: add other quantization types
  • lora: add t5 key support for sd35/f1
  • lora: maybe force imediate quantization
  • model load: force-reloading entire model as loading transformers only leads to massive memory usage
  • model load: implement model in-memory caching
  • modernui: monkey-patch for missing tabs.select event
  • modules/lora/lora_extract.py:188:9: W0511: TODO: lora: support pre-quantized flux
  • modules/modular_guiders.py:65:58: W0511: TODO: guiders
  • processing: remove duplicate mask params
  • resize image: enable full VAE mode for resize-latent