This is a fork of invoke-ai/InvokeAI, a popular SD implementation with great features and GUI. It provides a streamlined GUI inside Unreal Engine to easily generate game-ready textures.
Quick links: [Discord Server]
This fork is supported across multiple platforms. You can find individual installation instructions below.
-
[1] Follow the install instructions at invoke-ai/InvokeAI and get that running normally
First switch to the correct folder and conda environment and then start the server. It should say "Point your browser at xxxxxxx" if launched succesfully
(base) conda activate invokeai
(invokeai) cd C:\AI\Unreal-Diffusion (example, depending on where you cloned the repo)
(invokeai) python scripts/legacy_api.py --web --port 3333 -o outputs/img-samples/unreal-diffusion
Back in unreal, go to the Unreal Diffusion folder and find the "Unreal_Diffusion" Editor Utility Widget, right-click that and press "Run Editor Utility Widget as in the image below. This should start the UI which looks like this and you are ready to start generating images/textures
- Realtime - toggle that will generate the images without freezing unreal, but may generate slower. Off by default
- Seamless - Forces SD to generate seamless images. Sometimes you could try to have this off and instead type seamless in the prompt
Most docs here link to InvokeAI's as they are very detailed and show usecases and syntax
- v0.6.0 (30 October 2022)
- Added Img2Img support
- Cleaned up UI.
- Fixed reset button bugs.
- Added export of texture if source file not found.
- Added more sliders to UI
- v0.5.0 (23 October 2022)
- initial version with prompt/negative prompts, cfg, steps features
If the images won't generate due to VRAM, try lowering the resolution or temporarily load an empty level in unreal to generate images.
Anyone who wishes to contribute to this project, whether documentation, features, bug fixes, code cleanup, testing, or code reviews, is very much encouraged to do so. If you are unfamiliar with how to contribute to GitHub projects, here is a Getting Started Guide.
A full set of contribution guidelines, along with templates, are in progress, but for now the most important thing is to make your pull request against the "development" branch, and not against "main". This will help keep public breakage to a minimum and will allow you to propose more radical changes.
This fork is at the moment handled by me, with the main features/backend API coming from InvokeAI.
For support, please use this repository's GitHub Issues tracking service. Feel free to send me an email if you use and like the plugin.
Original portions of the software are Copyright (c) 2022 Emil Eldstål