All workerflow instances stop in running state

[chain312]

SUMMARY

I use K8s to deploy the project. When I use the kafka trigger to launch the script, I can see the workerflow instance on the page, but it is stuck in the running state all the time. What should be the problem?

STACKSTORM VERSION

Paste the output of st2 --version:
st2 3.8.0, on Python 3.8.10

OS, environment, install method

Kubernetes

Steps to reproduce the problem

When I click to re-execute this workerflow instance from the page

Stackstorm-st2actionrunner pod will have logs to print.

2024-02-22 12:36:12,758 INFO [-] [65d73f26268fcf5da563a5ea] Workflow execution "65d73fbce544bd29a96e43b1" is created.
2024-02-22 12:36:12,786 INFO [-] [65d73f26268fcf5da563a5ea] Workflow execution "65d73fbce544bd29a96e43b1" is published.

There is no processing in st2workerflowengine.

2024-02-22 12:36:28,904 INFO [-] (PID=1) Workflow engine started.
2024-02-22 12:36:28,904 INFO [-] Starting WorkflowExecutionHandler...
2024-02-22 12:36:59,030 INFO [-] Connected to amqp://admin:**@stackstorm-rabbitmq:5672//

Expected Results

Normal operation

Actual Results

This workerflow instance is stuck in running state.

The workerflow instance goes from request state to scheduler state and then to running, and then it gets stuck. Which program should I fix?

Thanks!