/pyxgt

Primary LanguagePythonApache License 2.0Apache-2.0

PyxGT: Explore your data with Deep Analytics


PyPi

Latest Version Latest Version License PyPI - Downloads PyPI - Downloads

GitHub

GitHub stars

Social Media

Twitter Follow

Trovares xGT is the fastest Deep Analytics Platform on the market and perfect for your mission-critical applications. With performance speeds 100's of times that of current market options, you can now empower your data scientist with the best development environment to meet your needs.

Demos

There are several demo notebooks available within this repo.

Getting Started

You need to set up a Trovares xGT server on a platform that makes sense for you, and set up a Python environment from which the Trovares xGT client is run. It is best to set up your client environment first as some Python packages are needed in order to set up some of the server environments.

Client Setup

The client can run from any Python environment, including Jupyter Notebook and Jupyter Lab.

Anaconda

One of the easiest ways to get a Jupyter environment is to install anaconda. Once installed, open an "anaconda prompt" window and run these commands:

pip install --upgrade grpcio jupyter pandas protobuf xgt

If an AWS instance will be used for running the Trovares xGT server, then you should also do this command:

pip install --upgrade boto3

An alternative to the anaconda prompt/command-line method, is to launch a Jupyter Notebook and perform these commands in notebook cells.

Command-line on Mac

The first step on a Mac is to ensure that a Python (version 3.5 or later) is installed along with a pip package. If you are using Homebrew as your package manager, these packages can be installed by doing this command in a Terminal window (or your favorite alternative to a bash shell):

$ brew install python3

Command-line on Linux

The first step on a native Linux platform is to ensure that a Python (version 3.5 or later) is installed. For those distributions that use RPM and the yum package manager:

$ sudo yum install python3 python3-devel python3-pip

On debian-based systems with the apt package manager:

$ sudo apt install python3 python3-dev python3-pip

After these O/S packages are installed, the Python packages can be installed:

$ pip install --upgrade boto3 grpcio jupyter pandas protobuf xgt

Note that on some systems, pip will invoke the deprecated Python2 system. If this is the case, then you will need to do pip3 wherever pip is shown in commands. Also note that you may be required to install these pip packages in your user environment. This is done by appending --user at the end of a pip command.

Server Setup

Running the Trovares xGT application can be done in a variety of locations.

On AWS

  1. A quick launch of Trovares xGT stack on AWS using CloudFormation: Launch Stack
  2. Running Trovares xGT on your own AWS instances from the AWS Marketplace.
  3. An AWS cloud instance running Trovares xGT.

On your own systems

  1. A docker daemon running on your platform (on-premises).
    • Any x86 system running docker can be used.
    • There are two versions available;
      • The trovares/xgt image where the application runs as the root user.
      • The trovares/nonroot-xgt image where the application runs as the xgtd user.
    • Perform the equivalent of docker pull trovares/xgt.
    • More information is available at trovares/xgt and trovares/nonroot-xgt.
  2. A docker daemon (docker desktop) running on your laptop.
    • The docker desktop hosting environment can run on:
      • Windows (with WSL2 enabled)
      • Mac Intel Chips
      • Native Linux