siliconflow/onediff

Black image got when infer Open-Sora-Plan-v1.1.0

littletomatodonkey opened this issue · 0 comments

Hi, when i use videosys repo for the Sora inference, and add onediff support, which is as follows.

        from onediff.infer_compiler import compile
        options = '{"mode": "O3"}'  # mode can be O2 or O3
        engine.driver_worker.transformer = compile(
            engine.driver_worker.transformer,
            backend="nexfort",
            options=options,
        )

I found that the generated video is black while normal when i do not use the onediff compiler.

I saw some issues saying that i need to set env, export ONEFLOW_ATTENTION_ALLOW_HALF_PRECISION_ACCUMULATION=False. I tried it but also does not work. Can you provide some other ideas? Thanks!

Some key packages' version are as follows.

onediff                    1.2.0
nexfort                    0.1.dev271
torch                      2.4.1
torchvision                0.19.1