为什么会出现衣服特征丢失？

[pangfeng1985]

为什么会出现衣服特征丢失？本来穿着衣服的变成没穿衣服？应该怎么调参数？

rank_01_00_00_seed_11_image_randomref_dwpose_._768x512.mp4

[wangxiang1230]

Hi, the result generated by the model has some randomness, maybe you can try another seed (

UniAnimate/configs/UniAnimate_infer_long.yaml

Line 9 in dfa7598

seed: 7

)

[wangxiang1230]

为什么会出现衣服特征丢失？本来穿着衣服的变成没穿衣服？应该怎么调参数？

rank_01_00_00_seed_11_image_randomref_dwpose_._768x512.mp4

Hi, we add a noise prior in this code, which helps to preserve the apperance. Refer to

UniAnimate/tools/inferences/inference_unianimate_long_entrance.py

Line 381 in ec5a962

noise = diffusion.q_sample(random_ref_frame.clone(), getattr(cfg, "noise_prior_value", 939), noise=noise)

for more details.