Need to bring back example of how to write a profile as a reference in WhyLabs
Closed this issue · 1 comments
Description
The examples on writing reference profiles now only show how to do so implicitly in the log statement, rather than after profiling. This approach does not work for map-reduce scenarios like Spark which necessarily decouples profiling from writing the upload so that the parts can be reduced (many profiles merged from the dataset's partitions where each partition gets one profile).
We need to bring back examples of how to use the WhyLabsWriter to send a profile as a reference profile.
e.g. see example showing this here: https://github.com/whylabs/whylogs/blob/dev/jamie/image_debug_demo/python/examples/integrations/writers/Writing_Reference_Profiles_to_WhyLabs.ipynb
- I have reviewed the Guidelines for Contributing and the Code of Conduct.
This issue is stale. Remove stale label or it will be closed next week.