FMInference/FlexLLMGen

When will the optimizer for determining offload strategy be released?

frankxyy opened this issue · 0 comments

Currently, the parameters for the offload strategy is passed from the command line by the user. When will the optimizer be released for users to search for the parameters?