How to avoid the long time required for the first warm up after compile the model

Question

How to avoid the long time required for the first warm up after compile the model

wz0424 opened this issue a year ago · 2 comments

The acceleration of sfast performs very well, but the first warm up takes a bit too long. If I need to switch between different models frequently, it will take a very long time on warm up, is there any way to avoid this problem?

Answer 1 · 2024-01-04T08:35:52.000Z

the same issue +1

Answer 2 · 2024-01-15T04:12:47.000Z

@wz0424 @Hap-Zhang See https://github.com/chengzeyi/stable-fast/blob/main/doc/troubleshooting.md#compilation-is-so-slow-how-to-improve-it