Programatically search and download files
Opened this issue · 0 comments
rishighan commented
Hello @maksis
I tangentially referred to this use-case on Discord, but outlining it here in detail for posterity:
Primarily:
- I want to call
search
programmatically, based on a list of files matching a certain criteria. The query is constructed dynamically, and passed to the search. - Subsequently, I want to rank the search results.
- Finally, I want to download the highest ranked result programmatically.
So far, I have cobbled together:
- The service that runs the search
- The kafka producer and consumer that construct the search query, perform the search and orchestrate the results.
My challenges:
- When I conduct a "search" for a bunch of files, I have no control on the
search instance
and hence the results all get coalesced into a single object. - I still have to de-dupe the results because of how the
search_results_added
andsearch_results_updated
events affect the search results.
I saw that you linked to https://github.com/peps1/airdcpp-auto-downloader/tree/master, and I like it, however it adds another dependency to the mix, and the users of ThreeTwo
will be expected to configure it as such.
I think that I am missing a few pieces from achieving my stated goal, just need your input.