nlkitai/nlux

LangServe adapter with Configurable

Closed this issue · 3 comments

jlev commented

I'm now trying to set some configurable options on my LangServe chains, but it looks like I can only set input keys with inputPreprocessor.

Is there a way to override the getRequestBody method to send additional options alongside the input?

jlev commented

I was able to figure out how to pass the data I need in the request headers, but this might still be a useful option for other use cases. Eg https://github.com/langchain-ai/langserve/blob/main/examples/configurable_agent_executor/server.py

salmenus commented

Hi @jlev — New LangServe config added here:
https://docs.nlkit.com/nlux/reference/adapters/langchain-langserve#langserve-config

The config present there will go into the request body.
Does this satisfy your requirement ?

salmenus commented

Closing this as feature was delivered, and documented — and no further requirements were mentioned.