/openOutpaint

local offline javascript and html canvas outpainting gizmo for stable diffusion webUI API 🐠

Primary LanguageJavaScriptMIT LicenseMIT

hello there 🐠

20221203demo.mp4

silly demo example current as of 9b174d6 / v0.0.8 / 2022-12-03 //TODO UPDATE SRSLY

this is a completely vanilla javascript and html canvas outpainting convenience doodad built for the API optionally exposed by AUTOMATIC1111's stable diffusion webUI, operating similarly to a few others that are probably more well-known. this simply offers an alternative for my following vain desires:

  • avoiding the overhead of an additional virtual python environment or impacting a pre-existing one
  • operates against the API exposed by A1111's webUI
  • no external dependencies, extremely boring vanilla
  • no external connectivity, self-hosted and offline
  • unobfuscated (cough cough)
  • i am terrible at javascript and should probably correct that
  • i have never used html canvas for anything before and should try it out

features

  • SDXL "support"! (please check outpaint/inpaint fill types in the context menus and fiddle with denoising a LOT for img2img, it's touchy)
  • now available as an extension for webUI! you can find it under the default "available" section in the webUI extensions tab
    • NOTE: extension still requires --api flag in webui-user launch script
  • intuitive, convenient outpainting - that's like the whole point right
  • queueable, cancelable dreams - just start a'clickin' all over the place
  • arbitrary dream reticle size - draw the rectangle of your dreams
  • an effectively infinite, resizable, scalable canvas for you to paint all over
    • NOTE: v0.0.10 introduces a new "camera control" modifier key - hold [CTRL] and use the scrollwheel to zoom (scroll the wheel or use the two-finger vertical gesture on, uh, modern touchpads) and pan (hold the scrollwheel button, or if you don't have one, left-click button) around the canvas
  • extremely limited, janky support for a shockingly restrictive list of A1111 extensions including controlnet inpainting for legitimately magic promptless inpainting and outpainting (a, b, c) and in-line reference preprocessors for keeping existing style while replacing things (reference requires at least 2 controlnet units enabled in A1111 settings), as well as a very very basic dynamic-prompts-on-or-off toggle
    • NOTE: this is JANKY, pull requests greatly welcomed lol
  • a very nicely functional and familiar layer system
  • save, load, import, and export workspaces - includes all your layers, history, canvas size, you name it!
  • inpainting/touchup mask brush
  • webUI script support (but you gotta find it)
  • prompt history panel
  • optional (visibly) inverted mask mode - red masks get mutated, blue masks stay the same, but you can't take both pills at once
  • inpainting color brush to bring out your inner vincent van bob ross
  • dedicated img2img tool with optional border masking for enhanced output coherence with existing subject matter
  • marquee select tool to select regions and arbitrarily scale, rotate, create stamps, move chunks, peek at lower layers, do all sorts of damage
  • optionally decoupled cursor size and output resolution
  • interrogate tool
  • floating control panel to easily change models/samplers/steps/prompts/CFG/etc options for each dream summoned from the latent void (NOTE: model switching requires A1111 webUI to be on commit 5a6387e or more recent)
  • floating toolbox with handy keyboard shortcuts
  • optional grid snapping for precision
  • optional hi-res fix for blank/txt2img dreams
    • NOTE: as of v0.0.12.5/webUI commit ef27a18, HRfix has been COMPLETELY reworked and no longer works remotely the same, thus openOutpaint's implementation is no longer compatible with versions of A1111 predating that. You will be alerted to the outdated webUI and the HRfix option will become limited to simply using [reticle dimensions / 2] in this event. Please see the manual entry regarding HRfix and its available options.
  • optional overmasking for potentially better seams between outpaints - set overmask px value to 0 to disable the feature
  • import arbitrary images and rotate/scale/stamp on the canvas whenever, wherever you'd like
  • upscaler support for final output images
  • saves your preferences/imported images to browser localstorage for maximum convenience
  • reset to defaults button to unsave your preferences if things go squirrely
  • floating navigable undo/redo palette with ctrl+z/y keyboard shortcuts for additional maximum convenience and desquirreliness
  • optional generate-ahead function to keep crankin' out the dreams while you look through the ones that already exist
  • all this and much more for the low, low price of simply already owning an expensive GPU!

operation

NOTE: PLEASE SEE DOCUMENTATION REGARDING NEW HRfix FEATURES IMPLEMENTED AS OF webUI COMMIT ef27a18

prerequisities

you'll obviously need A1111's webUI installed before you can use this, thus you're presumed to have an operational python install up and running to boot.

A1111 webUI must be launched with the --api flag enabled, and the --cors-allow-origins= flag set with the host where openOutpaint will be running.

NOTE: the commandline flag --gradio-debug disables custom API routes and completely breaks openOutpaint. please remove it from your COMMANDLINE_ARGS before running openOutpaint.

surprising incompatibilities

COLAB USERS: you may experience issues installing openOutpaint (and other webUI extensions) - there is a workaround that has been discovered and tested against TheLastBen's fast-stable-diffusion. Please see this discussion containing the workaround, which requires adding a command into the final cell of the colab, as well as setting Enable_API to True.

If anything goes wrong with openOutpaint, try running it on another browser and disable all extensions and try again. If a new incompatible extension is found, please open an issue so we can notify other users of extension incompatibilities.

quickstart speedrun

  1. edit your cors-allow-origins to include https://zero01101.github.io and run webUI
  2. go to https://zero01101.github.io/openOutpaint/ and fill in the host value with your webUI API address
  3. click things and do stuff

step-by-step actually useful instructions

please see the quickstart wiki article and comprehensive manual.

pull requests/bug reports

please do! see contributing for details!

warranty

lmao