microsoft/fadtk

Accessing score when running on custom baseline

MikeMpapa opened this issue · 1 comments

Thanks for this great repo! Very good work!

I am trying to run on my own baseline but I don't think the output is being stored anywhere.
How can I access FAD scores once I run on my baseline ?

Options to store output into csv and also -inf and -indiv flags don't seem to work in the 'Example 3' case.

Thanks again!

Since the FAD / FAD∞ score between a baseline and an evaluation set is just a single number, it was printed to standard output.

image_2023-12-23_01-38-37

However, since you brought this up, I just added an option to append these single-value results to an output CSV file. Now you can specify a CSV path as the last argument for non-individual FAD / FAD∞ as well. You can install the latest developmental branch using pip install git+https://github.com/microsoft/fadtk

image_2023-12-23_01-58-51

Also, I just tested that --inf and --indiv flags both work under the Example 3 case as shown below. Please make sure you're using the command correctly with two dashes before the flag (i.e. --inf). I noticed that in your issues, you were using a single dash to specify the argument (i.e. -inf), which would be incorrect.

image_2023-12-23_01-41-32