This repository contains a set of Jupyter notebooks that help you in evaluating the performance of your trained Watson Developer Cloud services. Specifically, it includes notebooks for Natural Language Classifier, Watson Conversation Service, and Watson Visual Recognition service. We will add notebooks for other services as they become available.
To use these notebooks, you need the following:
- A Unix-based OS (or Cygwin)
- Git
- python 2 or python 3
- Anaconda - Installing this package also installs the Jupyter notebook package, which includes iPython (now referred to as jupyter)
- A Bluemix account
- An instance of the Watson service of interest
If you are using a Linux system, the git, anaconda, python, and node.js packages may be installable through your system's package manager.
- pip install watson-developer-cloud
- pip install pandas-ml
- git clone https://github.com/joe4k/wdcutils.git
- Open example_parms.json in a text editor and update the parameters:
- NLC credentials(url, username, password)
- classifier id of trained classifier
- input test csv file
- results csv file to write output results to including confidence of classification results
- confusion matrix csv file to write the confusion matrix with labels
- jupyter notebook ==> this launches the notebook in a browser.
- Navigate to notebooks directory
- Click NLCPerformanceEval.ipynb ==> This launches the notebook for measuring performance of your trained classifier of Natural Language Classifier instance.
- Point to example_parms.json file in your notebook.
- Execute the various steps of the notebook by providing the required parameters.
This sample code is licensed under Apache 2.0. Full license text is available in LICENSE.