CADS is only applied to the first image when batch is greater than 1

Question

CADS is only applied to the first image when batch is greater than 1

Closed this issue a year ago · 4 comments

Hi,

First of all, thanks for a unique and fun extension!

One bug I just noticed is that when CADs is enabled and the batch size is greater than 1, CADs is only applied to the first timage of the batch. Expected functionality would be for it to be applied to all image generations in the batch.

I did replicate this issue even w/ all other extensions in my A1111 install disabled. I am using the latest dev branch commit, but I doubt that's related to this issue.

To replice:

Enter a simple prompt / enter a seed number (to keep it locked) / set batch size to 3 / Generate Images
Enable CADS
Generate w/ the same settings as above but w/ CADS enabled
Notice that CADS was applied to image 1, but not 2 and 3.

If this turns out to be user error somehow my sincere apologies. Thanks!

Answer 1 · 2023-11-03T08:03:02.000Z

Thanks for the report!
I'm not able to reproduce this behavior on my end.

What video card do you have? It could be related to generating NaN in the hook. If you start WebUI with the environment variable "SD_WEBUI_LOG_LEVEL" set to "DEBUG", see if any errors/warnings being thrown by the extension.

A couple other things to try: turn on/off Rescale CFG; change RNG source in options.

Let me know if any of these help ~

Answer 2 · 2023-11-03T15:32:25.000Z

Thanks for the reply!

First thing I wanted to do was rollback to 1.6 (final) to exclude any issues in the development branch. Did that and still get the same results where any image after the 1st is ignored by CADS. So that doesn't seem to be related.

The issue happens w/ CFG toggled on or off, and I tried changing the RNG setting from Nvidia to CPU - neither affected this issue. I also tried toggling "Upcast cross attention layer to float32" back to 'off' as I'd toggled that on recently as a workaround for an issue w/ a different extension - no effect.

Yea, so I'm not really sure. I didn't see any errors in the console, but when I get a chance (at work now) I'll enable the flag you mentioned and see if anything comes up at that point.

I'm not sure if helpful, but I've attached a zip of 3 batches of images I generated using the same prompt/settings only one set of 3 has CADS disabled, one has CADS enabled, and one has CADS enabled w/ the CFG rescale set to False. 7 of the 9 images are the same, the only unique ones are the first images in the batches w/ CADS enabled (Note: the CFG rescale did have an effect w/ the other 2 being different from each other). If you look at the metadata for these images (PNG info for exa
cads-3-batches-on-off-on-no-cfg.zip
mple) there is a tag indicating "CADS Active" on the images generated where it was toggled - and you'll notice pairs of duplicate images were generated w/ it on & off.

I run an NVidia 4090 (FE) on a 1yr old workstsation (139000 / 64gb RAM). Using Windows 10. Here's the main parts of my "sys info" from settings. (This lists extensions but I did test it w/o any other extensions loaded):

{
"Platform": "Windows-10-10.0.19045-SP0",
"Python": "3.10.11",
"Version": "v1.6.0-263-g464fbcd9",
"Commit": "464fbcd92118bf00173b9982325fe6348201313e",
"Script path": "D:\stable-diffusion-webui",
"Data path": "D:\stable-diffusion-webui",
"Extensions dir": "D:\stable-diffusion-webui\extensions",
"Checksum": "00ae718a9d5f7dab68db8a7562f939bb9c7eb9fbcfcd4629b0f378ee56403fc3",
"Commandline": [
"launch.py",
"--opt-sdp-attention",
"--no-half-vae",
"--opt-channelslast",
"--skip-torch-cuda-test",
"--skip-version-check",
"--ckpt-dir",
"e:\Stable Diffusion Checkpoints"
],
"Torch env info": {
"torch_version": "2.0.1+cu118",
"is_debug_build": "False",
"cuda_compiled_version": "11.8",
"gcc_version": null,
"clang_version": null,
"cmake_version": "version 3.28.0-rc2",
"os": "Microsoft Windows 10 Pro",
"libc_version": "N/A",
"python_version": "3.10.11 (tags/v3.10.11:7d4cc5a, Apr 5 2023, 00:38:17) [MSC v.1929 64 bit (AMD64)] (64-bit runtime)",
"python_platform": "Windows-10-10.0.19045-SP0",
"is_cuda_available": "True",
"cuda_runtime_version": "11.8.89\r",
"cuda_module_loading": "LAZY",
"nvidia_driver_version": "531.68",
"nvidia_gpu_models": "GPU 0: NVIDIA GeForce RTX 4090",
"cudnn_version": "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.8\bin\cudnn_ops_train64_8.dll",
"pip_version": "pip3",
"pip_packages": [
"groundingdino==0.1.0+torch2.0.1.cu118",
"numpy==1.23.5",
"open-clip-torch==2.20.0",
"pytorch-lightning==1.9.4",
"torch==2.0.1+cu118",
"torchdiffeq==0.2.3",
"torchmetrics==1.2.0",
"torchsde==0.2.6",
"torchvision==0.15.2+cu118"
],
"conda_packages": null,
"hip_compiled_version": "N/A",
"hip_runtime_version": "N/A",
"miopen_runtime_version": "N/A",
"caching_allocator_config": "",
"is_xnnpack_available": "True",
"cpu_info": [
"Architecture=9",
"CurrentClockSpeed=3000",
"DeviceID=CPU0",
"Family=207",
"L2CacheSize=16384",
"L2CacheSpeed=",
"Manufacturer=GenuineIntel",
"MaxClockSpeed=3000",
"Name=13th Gen Intel(R) Core(TM) i9-13900K",
"ProcessorType=3",
"Revision="

"CPU": {
"model": "Intel64 Family 6 Model 183 Stepping 1, GenuineIntel",
"count logical": 32,
"count physical": 24
},
"RAM": {
"total": "64GB",
"used": "44GB",
"free": "20GB"
},
"Extensions": [
{
"name": "Styles-Editor",
"path": "D:\stable-diffusion-webui\extensions\Styles-Editor",
"version": "bb0b51b6",
"branch": "main",
"remote": "https://github.com/chrisgoringe/Styles-Editor.git"
},
{
"name": "a2-sd-dynamic-prompts",
"path": "D:\stable-diffusion-webui\extensions\a2-sd-dynamic-prompts",
"version": "39c06b30",
"branch": "main",
"remote": "https://github.com/adieyal/sd-dynamic-prompts.git"
},
{
"name": "adetailer",
"path": "D:\stable-diffusion-webui\extensions\adetailer",
"version": "6b41b3db",
"branch": "main",
"remote": "https://github.com/Bing-su/adetailer.git"
},
{
"name": "b1111-sd-webui-tagcomplete",
"path": "D:\stable-diffusion-webui\extensions\b1111-sd-webui-tagcomplete",
"version": "a7233a59",
"branch": "main",
"remote": "https://github.com/DominikDoom/a1111-sd-webui-tagcomplete.git"
},
{
"name": "frame2frame",
"path": "D:\stable-diffusion-webui\extensions\frame2frame",
"version": "",
"branch": null,
"remote": null
},
{
"name": "sd-Img2img-batch-interrogator",
"path": "D:\stable-diffusion-webui\extensions\sd-Img2img-batch-interrogator",
"version": "7f4e4eb0",
"branch": "main",
"remote": "https://github.com/Alvi-alvarez/sd-Img2img-batch-interrogator.git"
},
{
"name": "sd-extension-system-info",
"path": "D:\stable-diffusion-webui\extensions\sd-extension-system-info",
"version": "1841cf76",
"branch": "main",
"remote": "https://github.com/vladmandic/sd-extension-system-info.git"
},
{
"name": "sd-webui-aspect-ratio-helper",
"path": "D:\stable-diffusion-webui\extensions\sd-webui-aspect-ratio-helper",
"version": "99fcf9b0",
"branch": "main",
"remote": "https://github.com/thomasasfk/sd-webui-aspect-ratio-helper.git"
},
{
"name": "sd-webui-cads",
"path": "D:\stable-diffusion-webui\extensions\sd-webui-cads",
"version": "80165cf5",
"branch": "main",
"remote": "https://github.com/v0xie/sd-webui-cads.git"
},
{
"name": "sd-webui-cleaner",
"path": "D:\stable-diffusion-webui\extensions\sd-webui-cleaner",
"version": "d89d173a",
"branch": "main",
"remote": "https://github.com/novitalabs/sd-webui-cleaner.git"
},
{
"name": "sd-webui-controlnet",
"path": "D:\stable-diffusion-webui\extensions\sd-webui-controlnet",
"version": "3011ff6e",
"branch": "main",
"remote": "https://github.com/Mikubill/sd-webui-controlnet.git"
},
{
"name": "sd-webui-model-mixer",
"path": "D:\stable-diffusion-webui\extensions\sd-webui-model-mixer",
"version": "36d95889",
"branch": "master",
"remote": "https://github.com/wkpark/sd-webui-model-mixer.git"
},
{
"name": "sd-webui-supermerger",
"path": "D:\stable-diffusion-webui\extensions\sd-webui-supermerger",
"version": "d929669d",
"branch": "main",
"remote": "https://github.com/hako-mikan/sd-webui-supermerger.git"
},
{
"name": "stable-diffusion-webui-model-toolkit",
"path": "D:\stable-diffusion-webui\extensions\stable-diffusion-webui-model-toolkit",
"version": "cf824587",
"branch": "master",
"remote": "https://github.com/arenasys/stable-diffusion-webui-model-toolkit.git"
},
{
"name": "stable-diffusion-webui-state",
"path": "D:\stable-diffusion-webui\extensions\stable-diffusion-webui-state",
"version": "f2bb3809",
"branch": "main",
"remote": "https://github.com/ilian6806/stable-diffusion-webui-state.git"
},
{
"name": "ultimate-upscale-for-automatic1111",
"path": "D:\stable-diffusion-webui\extensions\ultimate-upscale-for-automatic1111",
"version": "728ffcec",
"branch": "master",
"remote": "https://github.com/Coyote-A/ultimate-upscale-for-automatic1111.git"
}
],
"Inactive extensions": [],
"Environment": {
"COMMANDLINE_ARGS": "--opt-sdp-attention --no-half-vae --opt-channelslast --skip-torch-cuda-test --skip-version-check --ckpt-dir "e:\Stable Diffusion Checkpoints"",
"GRADIO_ANALYTICS_ENABLED": "False"
},
"Config": {
"samples_save": true,
"samples_format": "png",
"samples_filename_pattern": "[prompt_spaces]",
"save_images_add_number": true,
"grid_save": false,
"grid_format": "png",
"grid_extended_filename": false,
"grid_only_if_multiple": true,
"grid_prevent_empty_spots": false,
"grid_zip_filename_pattern": "",
"n_rows": -1,
"font": "",
"grid_text_active_color": "#000000",
"grid_text_inactive_color": "#999999",
"grid_background_color": "#ffffff",
"enable_pnginfo": true,
"save_txt": false,
"save_images_before_face_restoration": false,
"save_images_before_highres_fix": false,
"save_images_before_color_correction": false,
"save_mask": false,
"save_mask_composite": false,
"jpeg_quality": 80,
"webp_lossless": false,
"export_for_4chan": true,
"img_downscale_threshold": 4.0,
"target_side_length": 4000,
"img_max_size_mp": 200,
"use_original_name_batch": true,
"use_upscaler_name_as_suffix": false,
"save_selected_only": true,
"save_init_img": false,
"temp_dir": "d:\temp",
"clean_temp_dir_at_start": true,
"save_incomplete_images": false,
"outdir_samples": "E:\Stable Diffusion Images",
"outdir_txt2img_samples": "E:\Stable Diffusion Images",
"outdir_img2img_samples": "E:\Stable Diffusion Images",
"outdir_extras_samples": "E:\Stable Diffusion Images",
"outdir_grids": "E:\Stable Diffusion Images",
"outdir_txt2img_grids": "E:\Stable Diffusion Images",
"outdir_img2img_grids": "E:\Stable Diffusion Images",
"outdir_save": "E:\Stable Diffusion Images",
"outdir_init_images": "E:\Stable Diffusion Images",
"save_to_dirs": true,
"grid_save_to_dirs": false,
"use_save_to_dirs_for_ui": false,
"directories_filename_pattern": "[date]",
"directories_max_prompt_words": 8,
"ESRGAN_tile": 192,
"ESRGAN_tile_overlap": 8,
"realesrgan_enabled_models": [
"R-ESRGAN 4x+",
"R-ESRGAN 4x+ Anime6B"
],
"upscaler_for_img2img": null,
"face_restoration": false,
"face_restoration_model": "CodeFormer",
"code_former_weight": 0.5,
"face_restoration_unload": false,
"auto_launch_browser": "Local",
"show_warnings": false,
"show_gradio_deprecation_warnings": false,
"memmon_poll_rate": 8,
"samples_log_stdout": false,
"multiple_tqdm": true,
"print_hypernet_extra": false,
"list_hidden_files": true,
"disable_mmap_load_safetensors": false,
"hide_ldm_prints": true,
"api_enable_requests": true,
"api_forbid_local_requests": true,
"api_useragent": "",
"unload_models_when_training": false,
"pin_memory": false,
"save_optimizer_state": false,
"save_training_settings_to_txt": true,
"dataset_filename_word_regex": "",
"dataset_filename_join_string": " ",
"training_image_repeats_per_epoch": 1,
"training_write_csv_every": 500,
"training_xattention_optimizations": false,
"training_enable_tensorboard": false,
"training_tensorboard_save_images": false,
"training_tensorboard_flush_every": 120,
"sd_model_checkpoint": "SDXL\nightvisionXLPhotorealisticPortrait_release0770Bakedvae.safetensors [9aa0c3e54d]",
"sd_checkpoints_limit": 3,
"sd_checkpoints_keep_in_cpu": true,
"sd_checkpoint_cache": 2,
"sd_unet": "Automatic",
"enable_quantization": false,
"enable_emphasis": true,
"enable_batch_seeds": true,
"comma_padding_backtrack": 20,
"CLIP_stop_at_last_layers": 1,
"upcast_attn": true,
"randn_source": "GPU",
"tiling": false,
"hires_fix_refiner_pass": "second pass",
"sdxl_crop_top": 0,
"sdxl_crop_left": 0,
"sdxl_refiner_low_aesthetic_score": 2.5,
"sdxl_refiner_high_aesthetic_score": 6.0,
"sd_vae_explanation": "VAE is a neural network that transforms a standard RGB\nimage into latent space representation and back. Latent space representation is what stable diffusion is working on during sampling\n(i.e. when the progress bar is between empty and full). For txt2img, VAE is used to create a resulting image after the sampling is finished.\nFor img2img, VAE is used to process user's input image before the sampling, and to create an image after sampling.",
"sd_vae_checkpoint_cache": 1,
"sd_vae": "sdxl_vae.safetensors",
"sd_vae_overrides_per_model_preferences": true,
"auto_vae_precision": true,
"sd_vae_encode_method": "Full",
"sd_vae_decode_method": "Full",
"inpainting_mask_weight": 1.0,
"initial_noise_multiplier": 1.0,
"img2img_extra_noise": 0.0,
"img2img_color_correction": false,
"img2img_fix_steps": false,
"img2img_background_color": "#ffffff",
"img2img_editor_height": 720,
"img2img_sketch_default_brush_color": "#ffffff",
"img2img_inpaint_mask_brush_color": "#ffffff",
"img2img_inpaint_sketch_default_brush_color": "#ffffff",
"return_mask": false,
"return_mask_composite": false,
"cross_attention_optimization": "Automatic",
"s_min_uncond": 0.0,
"token_merging_ratio": 0.0,
"token_merging_ratio_img2img": 0.0,
"token_merging_ratio_hr": 0.0,
"pad_cond_uncond": false,
"persistent_cond_cache": true,
"batch_cond_uncond": true,
"use_old_emphasis_implementation": false,
"use_old_karras_scheduler_sigmas": false,
"no_dpmpp_sde_batch_determinism": false,
"use_old_hires_fix_width_height": false,
"dont_fix_second_order_samplers_schedule": false,
"hires_fix_use_firstpass_conds": false,
"use_old_scheduling": false,
"interrogate_keep_models_in_memory": false,
"interrogate_return_ranks": false,
"interrogate_clip_num_beams": 1,
"interrogate_clip_min_length": 24,
"interrogate_clip_max_length": 48,
"interrogate_clip_dict_limit": 1500,
"interrogate_clip_skip_categories": [],
"interrogate_deepbooru_score_threshold": 0.5,
"deepbooru_sort_alpha": true,
"deepbooru_use_spaces": true,
"deepbooru_escape": true,
"deepbooru_filter_tags": "",
"extra_networks_show_hidden_directories": true,
"extra_networks_hidden_models": "When searched",
"extra_networks_default_multiplier": 1.0,
"extra_networks_card_width": 0,
"extra_networks_card_height": 0,
"extra_networks_card_text_scale": 1.0,
"extra_networks_card_show_desc": true,
"extra_networks_add_text_separator": " ",
"ui_extra_networks_tab_reorder": "",
"textual_inversion_print_at_load": false,
"textual_inversion_add_hashes_to_infotext": true,
"sd_hypernetwork": "None",
"localization": "None",
"gradio_theme": "Default",
"gradio_themes_cache": true,
"gallery_height": "",
"return_grid": false,
"do_not_show_images": false,
"send_seed": true,
"send_size": true,
"js_modal_lightbox": true,
"js_modal_lightbox_initially_zoomed": true,
"js_modal_lightbox_gamepad": false,
"js_modal_lightbox_gamepad_repeat": 250,
"show_progress_in_title": true,
"samplers_in_dropdown": true,
"dimensions_and_batch_together": true,
"keyedit_precision_attention": 0.1,
"keyedit_precision_extra": 0.05,
"keyedit_delimiters": ".,\/!?%^*;:{}=`~()",
"keyedit_move": true,
"quicksettings_list": [
"sd_model_checkpoint",
"sd_vae"
],
"ui_tab_order": [],
"hidden_tabs": [],
"ui_reorder_list": [],
"hires_fix_show_sampler": false,
"hires_fix_show_prompts": false,
"disable_token_counters": false,
"add_model_hash_to_info": true,
"add_model_name_to_info": true,
"add_user_name_to_info": false,
"add_version_to_infotext": true,
"disable_weights_auto_swap": true,
"infotext_styles": "Apply if any",
"show_progressbar": true,
"live_previews_enable": true,
"live_previews_image_format": "png",
"show_progress_grid": false,
"show_progress_every_n_steps": -1,
"show_progress_type": "Full",
"live_preview_allow_lowvram_full": false,
"live_preview_content": "Prompt",
"live_preview_refresh_period": 1000,
"live_preview_fast_interrupt": false,
"hide_samplers": [],
"eta_ddim": 0.0,
"eta_ancestral": 1.0,
"ddim_discretize": "uniform",
"s_churn": 0.0,
"s_tmin": 0.0,
"s_tmax": 0.0,
"s_noise": 1.0,
"k_sched_type": "Automatic",
"sigma_min": 0.0,
"sigma_max": 0.0,
"rho": 0.0,
"eta_noise_seed_delta": 0,
"always_discard_next_to_last_sigma": false,
"sgm_noise_multiplier": false,
"uni_pc_variant": "bh1",
"uni_pc_skip_type": "time_uniform",
"uni_pc_order": 3,
"uni_pc_lower_order_final": true,
"postprocessing_enable_in_main_ui": [],
"postprocessing_operation_order": [],
"upscaling_max_images_in_cache": 5,
"disabled_extensions": [],
"disable_all_extensions": "none",
"restore_config_state_file": "",
"sd_checkpoint_hash": "9aa0c3e54d97825769ef455d52045b078fd9e83439a474e0763f1fbd4101cd88",
"ldsr_steps": 100,
"ldsr_cached": false,
"SCUNET_tile": 256,
"SCUNET_tile_overlap": 8,
"SWIN_tile": 192,
"SWIN_tile_overlap": 8,
"lora_functional": false,
"sd_lora": "None",
"lora_preferred_name": "Alias from file",
"lora_add_hashes_to_infotext": true,
"lora_show_all": false,
"lora_hide_unknown_for_versions": [],
"lora_in_memory_limit": 2,
"extra_options_txt2img": [],
"extra_options_img2img": [],
"extra_options_cols": 1,
"extra_options_accordion": false,
"canvas_hotkey_zoom": "Alt",
"canvas_hotkey_adjust": "Ctrl",
"canvas_hotkey_move": "F",
"canvas_hotkey_fullscreen": "S",
"canvas_hotkey_reset": "R",
"canvas_hotkey_overlap": "O",
"canvas_show_tooltip": true,
"canvas_auto_expand": true,
"canvas_blur_prompt": false,
"canvas_disabled_functions": [
"Overlap"
],
"ad_max_models": 2,
"ad_save_previews": false,
"ad_save_images_before": false,
"ad_only_seleted_scripts": true,
"ad_script_names": "dynamic_prompting,dynamic_thresholding,wildcard_recursive,wildcards,lora_block_weight",
"ad_bbox_sortby": "Position (left to right)",
"tac_tagFile": "danbooru.csv",
"tac_active": true,
"tac_activeIn.txt2img": true,
"tac_activeIn.img2img": true,
"tac_activeIn.negativePrompts": true,
"tac_activeIn.thirdParty": true,
"tac_activeIn.modelList": "",
"tac_activeIn.modelListMode": "Blacklist",
"tac_slidingPopup": true,
"tac_maxResults": 5.0,
"tac_showAllResults": false,
"tac_resultStepLength": 100.0,
"tac_delayTime": 100.0,
"tac_useWildcards": true,
"tac_sortWildcardResults": true,
"tac_useEmbeddings": true,
"tac_includeEmbeddingsInNormalResults": false,
"tac_useHypernetworks": true,
"tac_useLoras": true,
"tac_useLycos": true,
"tac_showWikiLinks": false,
"tac_showExtraNetworkPreviews": true,
"tac_modelSortOrder": "Name",
"tac_replaceUnderscores": true,
"tac_escapeParentheses": true,
"tac_appendComma": true,
"tac_appendSpace": true,
"tac_alwaysSpaceAtEnd": true,
"tac_modelKeywordCompletion": "Never",
"tac_modelKeywordLocation": "Start of prompt",
"tac_wildcardCompletionMode": "To next folder level",
"tac_alias.searchByAlias": true,
"tac_alias.onlyShowAlias": false,
"tac_translation.translationFile": "None",
"tac_translation.oldFormat": false,
"tac_translation.searchByTranslation": true,
"tac_translation.liveTranslation": false,
"tac_extra.extraFile": "extra-quality-tags.csv",
"tac_extra.addMode": "Insert before",
"tac_chantFile": "demo-chants.json",
"tac_keymap": "{\n "MoveUp": "ArrowUp",\n "MoveDown": "ArrowDown",\n "JumpUp": "PageUp",\n "JumpDown": "PageDown",\n "JumpToStart": "Home",\n "JumpToEnd": "End",\n "ChooseSelected": "Enter",\n "ChooseFirstOrSelected": "Tab",\n "Close": "Escape"\n}",
"tac_colormap": "{\n "danbooru": {\n "-1": ["red", "maroon"],\n "0": ["lightblue", "dodgerblue"],\n "1": ["indianred", "firebrick"],\n "3": ["violet", "darkorchid"],\n "4": ["lightgreen", "darkgreen"],\n "5": ["orange", "darkorange"]\n },\n "e621": {\n "-1": ["red", "maroon"],\n "0": ["lightblue", "dodgerblue"],\n "1": ["gold", "goldenrod"],\n "3": ["violet", "darkorchid"],\n "4": ["lightgreen", "darkgreen"],\n "5": ["tomato", "darksalmon"],\n "6": ["red", "maroon"],\n "7": ["whitesmoke", "black"],\n "8": ["seagreen", "darkseagreen"]\n }\n}",
"tac_refreshTempFiles": "Refresh TAC temp files",
"arh_javascript_aspect_ratio_show": true,
"arh_javascript_aspect_ratio": "1:1, 3:2, 4:3, 5:4, 16:9",
"arh_ui_javascript_selection_method": "Aspect Ratios Dropdown",
"arh_hide_accordion_by_default": true,
"arh_expand_by_default": false,
"arh_ui_component_order_key": "MaxDimensionScaler, MinDimensionScaler, PredefinedAspectRatioButtons, PredefinedPercentageButtons",
"arh_show_max_width_or_height": false,
"arh_max_width_or_height": 1024,
"arh_show_min_width_or_height": false,
"arh_min_width_or_height": 1024,
"arh_show_predefined_aspect_ratios": false,
"arh_predefined_aspect_ratio_use_max_dim": false,
"arh_predefined_aspect_ratios": "1:1, 4:3, 16:9, 9:16, 21:9",
"arh_show_predefined_percentages": false,
"arh_predefined_percentages": "25, 50, 75, 125, 150, 175, 200",
"arh_predefined_percentages_display_key": "Incremental/decremental percentage (-50%, +50%)",
"cleaner_use_gpu": true,
"control_net_detectedmap_dir": "detected_maps",
"control_net_models_path": "",
"control_net_modules_path": "",
"control_net_unit_count": 2,
"control_net_model_cache_size": 3,
"control_net_inpaint_blur_sigma": 7,
"control_net_no_high_res_fix": false,
"control_net_no_detectmap": false,
"control_net_detectmap_autosaving": false,
"control_net_allow_script_control": true,
"control_net_sync_field_args": true,
"controlnet_show_batch_images_in_ui": false,
"controlnet_increment_seed_during_batch": false,
"controlnet_disable_control_type": false,
"controlnet_disable_openpose_edit": false,
"controlnet_ignore_noninpaint_mask": false,
"model_toolkit_fix_clip": false,
"model_toolkit_autoprune": false,
"dp_ignore_whitespace": false,
"dp_write_raw_template": false,
"dp_write_prompts_to_file": false,
"dp_parser_variant_start": "{",
"dp_parser_variant_end": "}",
"dp_parser_wildcard_wrap": "__",
"dp_limit_jinja_prompts": false,
"dp_auto_purge_cache": false,
"dp_wildcard_manager_no_dedupe": false,
"dp_wildcard_manager_no_sort": false,
"dp_wildcard_manager_shuffle": false,
"dp_magicprompt_default_model": "Gustavosta/MagicPrompt-Stable-Diffusion",
"dp_magicprompt_batch_size": 1,
"save_images_replace_action": "Replace",
"notification_audio": true,
"enable_console_prompts": false,
"dump_stacks_on_signal": false,
"keyedit_delimiters_whitespace": [
"Tab",
"Carriage Return",
"Line Feed"
],
"sd_checkpoint_dropdown_use_short": false,
"bmab_debug_print": false,
"bmab_show_extends": false,
"bmab_test_function": false,
"bmab_keep_original_setting": false,
"bmab_save_image_before_process": false,
"bmab_save_image_after_process": false,
"bmab_max_detailing_element": 0,
"bmab_detail_full": true,
"bmab_optimize_vram": "None",
"bmab_mask_model": "sam_vit_b",
"bmab_use_specific_model": false,
"bmab_model": "",
"bmab_cn_openpose": "control_v11p_sd15_openpose_fp16 [73c2b67d]",
"bmab_cn_lineart": "control_v11p_sd15_lineart [43d4be0d]",
"bmab_cn_inpaint": "control_v11p_sd15_inpaint_fp16 [be8bc0ed]",
"state": [
"tabs"
],
"state_txt2img": [
"prompt",
"negative_prompt",
"extra_networks",
"styles",
"sampling",
"sampling_steps",
"width",
"height",
"batch_count",
"batch_size",
"cfg_scale",
"restore_faces",
"tiling",
"hires_fix",
"hires_upscaler",
"hires_steps",
"hires_scale",
"hires_resize_x",
"hires_resize_y",
"hires_denoising_strength",
"script"
],
"state_img2img": [
"prompt",
"negative_prompt",
"extra_networks",
"styles",
"sampling",
"resize_mode",
"sampling_steps",
"restore_faces",
"tiling",
"width",
"height",
"batch_count",
"batch_size",
"cfg_scale",
"denoising_strength",
"script"
],
"state_extensions": [
"control-net",
"adetailer",
"multidiffusion",
"dynamic prompting"
],
"mm_max_models": 3,
"mm_debugs": [
"elemental merge"
],
"mm_save_model": [
"safetensors",
"fp16",
"prune",
"overwrite"
],
"mm_save_model_filename": "modelmixer-[hash]",
"mm_use_extra_elements": true,
"mm_use_old_finetune": false,
"mm_use_unet_partial_update": false,
"ad_extra_models_dir": "",
"ad_same_seed_for_each_tap": false
},
"Startup": {
"total": 16.546937942504883,
"records": {
"initial startup": 0.0,
"prepare environment/checks": 0.00599980354309082,
"prepare environment/git version info": 0.050887346267700195,
"prepare environment/torch GPU test": 0.0013155937194824219,
"prepare environment/clone repositores": 0.08065152168273926,
"prepare environment/run extensions installers/a2-sd-dynamic-prompts": 0.0790550708770752,
"prepare environment/run extensions installers/adetailer": 0.06407427787780762,
"prepare environment/run extensions installers/b1111-sd-webui-tagcomplete": 0.0010364055633544922,
"prepare environment/run extensions installers/frame2frame": 1.33461594581604,
"prepare environment/run extensions installers/sd-extension-system-info": 0.043676137924194336,
"prepare environment/run extensions installers/sd-Img2img-batch-interrogator": 0.0,
"prepare environment/run extensions installers/sd-webui-aspect-ratio-helper": 0.0,
"prepare environment/run extensions installers/sd-webui-cads": 0.0,
"prepare environment/run extensions installers/sd-webui-cleaner": 0.04289579391479492,
"prepare environment/run extensions installers/sd-webui-controlnet": 0.1522078514099121,
"prepare environment/run extensions installers/sd-webui-model-mixer": 0.0,
"prepare environment/run extensions installers/sd-webui-supermerger": 0.04209017753601074,
"prepare environment/run extensions installers/stable-diffusion-webui-model-toolkit": 0.0,
"prepare environment/run extensions installers/stable-diffusion-webui-state": 0.0010027885437011719,
"prepare environment/run extensions installers/Styles-Editor": 0.0002446174621582031,
"prepare environment/run extensions installers/ultimate-upscale-for-automatic1111": 0.0,
"prepare environment/run extensions installers": 1.7608990669250488,
"prepare environment": 1.9462215900421143,
"launcher": 0.0015974044799804688,
"import torch": 2.7775063514709473,
"import gradio": 0.7143259048461914,
"setup paths": 0.725407600402832,
"import ldm": 0.005124330520629883,
"import sgm": 0.0,
"initialize shared": 0.19129180908203125,
"other imports": 0.6511733531951904,
"opts onchange": 0.0010001659393310547,
"setup SD model": 0.0009999275207519531,
"setup codeformer": 0.11156630516052246,
"setup gfpgan": 0.019360065460205078,
"set samplers": 0.0,
"list extensions": 0.0,
"restore config state file": 0.0,
"list SD models": 0.3847005367279053,
"list localizations": 0.0,
"load scripts/custom_code.py": 0.08193850517272949,
"load scripts/img2imgalt.py": 0.00039577484130859375,
"load scripts/loopback.py": 0.00048804283142089844,
"load scripts/outpainting_mk_2.py": 0.00035643577575683594,
"load scripts/poor_mans_outpainting.py": 0.0,
"load scripts/postprocessing_codeformer.py": 0.0,
"load scripts/postprocessing_gfpgan.py": 0.001001596450805664,
"load scripts/postprocessing_upscale.py": 0.0,
"load scripts/prompt_matrix.py": 0.0,
"load scripts/prompts_from_file.py": 0.0011696815490722656,
"load scripts/refiner.py": 0.0004966259002685547,
"load scripts/sd_upscale.py": 0.0003306865692138672,
"load scripts/seed.py": 0.0,
"load scripts/xyz_grid.py": 0.0009677410125732422,
"load scripts/additionals.py": 0.0017359256744384766,
"load scripts/background.py": 0.00035834312438964844,
"load scripts/filemanager.py": 0.028038978576660156,
"load scripts/install.py": 0.0002346038818359375,
"load scripts/main.py": 0.2881355285644531,
"load scripts/shared.py": 0.0,
"load scripts/dynamic_prompting.py": 0.037920236587524414,
"load scripts/!adetailer.py": 0.7710978984832764,
"load scripts/model_keyword_support.py": 0.0021758079528808594,
"load scripts/shared_paths.py": 0.0,
"load scripts/tag_autocomplete_helper.py": 0.040367841720581055,
"load scripts/frame2frame.py": 0.10544967651367188,
"load scripts/sd_tag_batch.py": 0.0004222393035888672,
"load scripts/system-info.py": 0.028548002243041992,
"load scripts/sd_webui_aspect_ratio_helper.py": 0.03201913833618164,
"load scripts/cads.py": 0.0013790130615234375,
"load scripts/api.py": 0.15222430229187012,
"load scripts/clean_up_tab.py": 0.01900005340576172,
"load scripts/lama.py": 0.0,
"load scripts/adapter.py": 0.0009996891021728516,
"load scripts/batch_hijack.py": 0.001210927963256836,
"load scripts/cldm.py": 0.0005218982696533203,
"load scripts/controlmodel_ipadapter.py": 0.0008096694946289062,
"load scripts/controlnet.py": 0.11838364601135254,
"load scripts/controlnet_diffusers.py": 0.0,
"load scripts/controlnet_lllite.py": 0.0009999275207519531,
"load scripts/controlnet_lora.py": 0.0,
"load scripts/controlnet_model_guess.py": 0.0,
"load scripts/controlnet_version.py": 0.0,
"load scripts/external_code.py": 0.0,
"load scripts/global_state.py": 0.0009999275207519531,
"load scripts/hook.py": 0.0,
"load scripts/infotext.py": 0.0,
"load scripts/logging.py": 0.0,
"load scripts/lvminthin.py": 0.0,
"load scripts/movie2movie.py": 0.0012047290802001953,
"load scripts/processor.py": 0.0,
"load scripts/utils.py": 0.0,
"load scripts/xyz_grid_support.py": 0.0008730888366699219,
"load scripts/model_mixer.py": 0.041941165924072266,
"load scripts/patches.py": 0.0,
"load scripts/vxa.py": 0.0,
"load scripts/weight_matching.py": 0.0010001659393310547,
"load scripts/GenParamGetter.py": 0.14887380599975586,
"load scripts/supermerger.py": 0.01241612434387207,
"load scripts/toolkit_gui.py": 0.04078078269958496,
"load scripts/state_api.py": 0.010416746139526367,
"load scripts/state_settings.py": 0.009116649627685547,
"load scripts/ultimate-upscale.py": 0.0012099742889404297,
"load scripts/ldsr_model.py": 0.012539386749267578,
"load scripts/lora_script.py": 0.07129025459289551,
"load scripts/scunet_model.py": 0.01385951042175293,
"load scripts/swinir_model.py": 0.013181447982788086,
"load scripts/hotkey_config.py": 0.0006072521209716797,
"load scripts/extra_options_section.py": 0.00047707557678222656,
"load scripts": 2.099966526031494,
"load upscalers": 0.0019197463989257812,
"refresh VAE": 0.0070002079010009766,
"refresh textual inversion templates": 0.0,
"scripts list_optimizers": 0.0009999275207519531,
"scripts list_unets": 0.0,
"reload hypernetworks": 0.0009999275207519531,
"initialize extra networks": 0.026011943817138672,
"cleanup temp dir": 0.01808023452758789,
"scripts before_ui_callback": 0.002000093460083008,
"create ui": 6.4891111850738525,
"gradio launch": 0.338040828704834,
"add APIs": 0.0030002593994140625,
"app_started_callback/main.py": 0.03299975395202637,
"app_started_callback/tag_autocomplete_helper.py": 0.0010004043579101562,
"app_started_callback/system-info.py": 0.0010001659393310547,
"app_started_callback/api.py": 0.0009996891021728516,
"app_started_callback/GenParamGetter.py": 0.03899979591369629,
"app_started_callback/state_api.py": 0.0,
"app_started_callback/lora_script.py": 0.0010001659393310547,
"app_started_callback": 0.07599997520446777
}
},
"Packages": [
"absl-py==2.0.0",
"accelerate==0.21.0",
"addict==2.4.0",
"aenum==3.1.15",
"aiofiles==23.2.1",
"aiohttp==3.8.6",
"aiosignal==1.3.1",
"altair==5.1.2",
"antlr4-python3-runtime==4.9.3",
"anyio==3.7.1",
"async-timeout==4.0.3",
"attrs==23.1.0",
"basicsr==1.4.2",
"beautifulsoup4==4.12.2",
"blendmodes==2022",
"cachetools==5.3.2",
"certifi==2023.7.22",
"cffi==1.16.0",
"charset-normalizer==3.3.1",
"clean-fid==0.1.35",
"click==8.1.7",
"clip==1.0",
"colorama==0.4.6",
"contourpy==1.1.1",
"cryptography==41.0.5",
"cssselect2==0.7.0",
"cycler==0.12.1",
"decorator==4.0.11",
"deprecation==2.1.0",
"diffusers==0.21.4",
"dynamicprompts==0.29.0",
"einops==0.4.1",
"exceptiongroup==1.1.3",
"facexlib==0.3.0",
"fastapi==0.94.0",
"ffmpeg-python==0.2.0",
"ffmpeg==1.4",
"ffmpy==0.3.1",
"ffprobe==0.5",
"filelock==3.12.4",
"filterpy==1.4.5",
"flatbuffers==23.5.26",
"fonttools==4.43.1",
"frozenlist==1.4.0",
"fsspec==2023.10.0",
"ftfy==6.1.1",
"future==0.18.3",
"fvcore==0.1.5.post20221221",
"gdown==4.7.1",
"gfpgan==1.3.8",
"gitdb==4.0.11",
"gitpython==3.1.32",
"google-auth-oauthlib==1.1.0",
"google-auth==2.23.3",
"gradio-client==0.5.0",
"gradio==3.41.2",
"groundingdino==0.1.0+torch2.0.1.cu118",
"grpcio==1.59.0",
"h11==0.12.0",
"httpcore==0.15.0",
"httpx==0.24.1",
"huggingface-hub==0.18.0",
"idna==3.4",
"imageio-ffmpeg==0.4.9",
"imageio==2.31.6",
"importlib-metadata==6.8.0",
"importlib-resources==6.1.0",
"inflection==0.5.1",
"iopath==0.1.9",
"jinja2==3.1.2",
"joblib==1.3.2",
"jsonmerge==1.8.0",
"jsonschema-specifications==2023.7.1",
"jsonschema==4.19.1",
"kiwisolver==1.4.5",
"kornia==0.6.7",
"lark==1.1.2",
"lazy-loader==0.3",
"lightning-utilities==0.9.0",
"litelama==0.1.7",
"llvmlite==0.41.1",
"lmdb==1.4.1",
"lpips==0.1.4",
"lxml==4.9.3",
"markdown-it-py==3.0.0",
"markdown==3.5",
"markupsafe==2.1.3",
"matplotlib==3.8.0",
"mdurl==0.1.2",
"mediapipe==0.10.7",
"moviepy==0.2.3.2",
"mpmath==1.3.0",
"multidict==6.0.4",
"networkx==3.2",
"numba==0.58.1",
"numpy==1.23.5",
"oauthlib==3.2.2",
"omegaconf==2.2.3",
"open-clip-torch==2.20.0",
"opencv-contrib-python==4.8.1.78",
"opencv-python==4.8.1.78",
"orjson==3.9.9",
"packaging==23.2",
"pandas==2.1.1",
"piexif==1.1.3",
"pillow==9.5.0",
"pip==23.3.1",
"platformdirs==3.11.0",
"portalocker==2.8.2",
"protobuf==3.20.0",
"psutil==5.9.5",
"py-cpuinfo==9.0.0",
"pyaescrypt==6.1.0",
"pyasn1-modules==0.3.0",
"pyasn1==0.5.0",
"pycocotools==2.0.7",
"pycparser==2.21",
"pydantic==1.10.13",
"pydub==0.25.1",
"pygments==2.16.1",
"pyparsing==3.1.1",
"pysocks==1.7.1",
"python-dateutil==2.8.2",
"python-multipart==0.0.6",
"pytorch-lightning==1.9.4",
"pytz==2023.3.post1",
"pywavelets==1.4.1",
"pywin32==306",
"pyyaml==6.0.1",
"realesrgan==0.3.0",
"referencing==0.30.2",
"regex==2023.10.3",
"reportlab==4.0.6",
"requests-oauthlib==1.3.1",
"requests==2.31.0",
"resize-right==0.0.2",
"rich==13.6.0",
"rpds-py==0.10.6",
"rsa==4.9",
"safetensors==0.3.1",
"scenedetect==0.6.2",
"scikit-image==0.21.0",
"scikit-learn==1.3.2",
"scipy==1.11.3",
"seaborn==0.13.0",
"segment-anything-hq==0.3",
"segment-anything==1.0",
"semantic-version==2.10.0",
"send2trash==1.8.2",
"sentencepiece==0.1.99",
"setuptools==65.5.0",
"six==1.16.0",
"smmap==5.0.1",
"sniffio==1.3.0",
"sounddevice==0.4.6",
"soupsieve==2.5",
"starlette==0.26.1",
"supervision==0.6.0",
"svglib==1.5.1",
"sympy==1.12",
"tabulate==0.9.0",
"tb-nightly==2.16.0a20231025",
"tensorboard-data-server==0.7.2",
"termcolor==2.3.0",
"thop==0.1.1.post2209072238",
"threadpoolctl==3.2.0",
"tifffile==2023.9.26",
"timm==0.9.2",
"tinycss2==1.2.1",
"tokenizers==0.13.3",
"tomesd==0.1.3",
"tomli==2.0.1",
"toolz==0.12.0",
"torch==2.0.1+cu118",
"torchdiffeq==0.2.3",
"torchmetrics==1.2.0",
"torchsde==0.2.6",
"torchvision==0.15.2+cu118",
"tqdm==4.66.1",
"trampoline==0.1.2",
"transformers==4.30.2",
"typing-extensions==4.8.0",
"tzdata==2023.3",
"ultralytics==8.0.201",
"urllib3==2.0.7",
"uvicorn==0.23.2",
"wcwidth==0.2.8",
"webencodings==0.5.1",
"websockets==11.0.3",
"werkzeug==3.0.1",
"yacs==0.1.8",
"yapf==0.40.2",
"yarl==1.9.2",
"zipp==3.17.0"
]
}

Answer 3 · 2023-11-05T14:38:30.000Z

I can confirm I am experiencing this same issue.
If I chose batch count of 4, only the first image is changed. If I do a batch size of 4 however, all the images are changed.

Auto1111 version: [1.6.0] • python: 3.10.11 • torch: 2.0.1+cu118 • xformers: 0.0.22 • gradio: 3.41.2

Answer 4 · 2023-11-05T23:53:43.000Z

I can confirm I am experiencing this same issue. If I chose batch count of 4, only the first image is changed. If I do a batch size of 4 however, all the images are changed.

Auto1111 version: [1.6.0] • python: 3.10.11 • torch: 2.0.1+cu118 • xformers: 0.0.22 • gradio: 3.41.2

Thanks for this. I was confusing batch count with batch size when trying to reproduce. Should be fixed now.