(autofix) Output continuation for Claude
Closed this issue · 2 comments
jennmueng commented
Continue the output for Claude via passing the output tokens back in + prefill assistant message.
jennmueng commented
Putting this on hold for now as it was found out that apparently you can pass the 8196 max tokens to claude on vertex now
roaga commented
claude on vertex support 8196 max tokens, so this is not needed