julep-ai/julep

feat(adaptive-context): Process image parts in summarization

Opened this issue · 0 comments

[only in adaptive mode] add some logic to handle messages that contain images. If message.image_url.detail != "low" then produce a new entry that "summarizes" that entry by setting detail to "low"

apply this first, see if the token threshold is still being breached and then apply the summarize step. we should do this before the trim operation too -- only apply the trim operation if the summarize and entities step result is still greater than the token threshold