defog-ai/sqlcoder

How long can metadata.sql be?

rabum opened this issue · 1 comments

rabum commented

As I see in the user FAQs of defog there seems to be a pruning layer, does that mean I can dump however many schemas into metadata.sql and just run python inference.py -q "Question about the sample database goes here", irrelevant tables will be pruned without worrying about LLM's context length?
image

Hi there, unfortunately not. Pruning is something that we provided in our hosted service, and is not yet available in the open-source version.