Accessing score when running on custom baseline
MikeMpapa opened this issue · 1 comments
Thanks for this great repo! Very good work!
I am trying to run on my own baseline but I don't think the output is being stored anywhere.
How can I access FAD scores once I run on my baseline ?
Options to store output into csv and also -inf and -indiv flags don't seem to work in the 'Example 3' case.
Thanks again!
Since the FAD / FAD∞ score between a baseline and an evaluation set is just a single number, it was printed to standard output.
However, since you brought this up, I just added an option to append these single-value results to an output CSV file. Now you can specify a CSV path as the last argument for non-individual FAD / FAD∞ as well. You can install the latest developmental branch using pip install git+https://github.com/microsoft/fadtk
Also, I just tested that --inf
and --indiv
flags both work under the Example 3 case as shown below. Please make sure you're using the command correctly with two dashes before the flag (i.e. --inf
). I noticed that in your issues, you were using a single dash to specify the argument (i.e. -inf
), which would be incorrect.