add limit arguments to functions that need it

Question

add limit arguments to functions that need it

Closed this issue a year ago · 2 comments

since the sdk routes through an api querying a database, there should be limit arguments in the sdk function calls. i noticed building a demo that the get_messages_for_session will return all messages. as they add up this will not only be an expensive query but will also exceed any useful threshold that could be handles in the context window of a language model.

Answer 1 · 2024-02-01T03:34:04.000Z

@VVoruganti do we want to build this into #7 ?

Answer 2 · 2024-02-08T19:33:24.000Z

closed by #11