truera/trulens

Additions to the Tru API for working with large databases

Closed this issue · 3 comments

epinzur commented

I've been working primarily with very large databases and I find the Tru API to be a bit lacking.

In particular, methods like the following would be very helpful:

  • * tru.list_records(app_id): Get a list of record_ids in an app.
  • * tru.get_record_and_feedback(record_id): Get a single record and its feedback results from the database.
  • * tru.delete_record(record_id): Delete a single record from the database. (Useful to remove duplicate records from an App without having to reset the database and start over)
  • * tru.delete_app(app_id): Delete an app from the database. (without having to reset the database and start over) (Helpful when an App run didn't complete due to an exception) - done in #1061 by @arn-tru

These methods would be helpful, but not as high priority:

  • * tru.get_incomplete_records(app_id, [feedback_function_names]): Returns a list of record_ids where the passed feedback function names don't yet have a value. Basically a way to test if the app has a full set of data yet, and if not, return the records that need to be finished.

Finally, some paging functionality would be helpful on:

  • * tru.get_records_and_feedback(app_ids)
priyalorha commented

#939 ?

  • 👀1
arn-tru commented

Hi @epinzur,

We're excited to announce that the delete_app functionality has been implemented and will be available in the next release!

  • 🎉1
dosubot commented

Hi, @epinzur,

I'm helping the trulens team manage their backlog and am marking this issue as stale. From what I understand, you requested additional methods to be added to the Tru API to better support working with large databases. There have been some developments in the comments, including a pull request from priyalorha and the implementation of the delete_app functionality announced by arn-tru.

Could you please confirm if this issue is still relevant to the latest version of the trulens repository? If it is, please let the trulens team know by commenting on the issue. Otherwise, feel free to close the issue yourself, or it will be automatically closed in 7 days. Thank you!

  • 👍1
  • 👎1