kbot_mxnet

MXNetwork java class wrapping implemented with MXNet via JNI / C++.

Compile MXNet

cd ~/git
git clone https://github.com/apache/incubator-mxnet mxnet
cd mxnet
git checkout v1.9.x
git submodule update --init --recursive

If no python but there is python3 (default Ubuntu):

sudo update-alternatives --install /usr/bin/python python /usr/bin/python3 3

Follow https://mxnet.apache.org/get_started/build_from_source

cp config/linux.cmake config.cmake
--> edit the file to switch USE_CPP_PACKAGE ON
mkdir build
cd build
cmake -DCMAKE_BUILD_TYPE=Release -DCMAKE_C_FLAGS="-O3 -march=native" -DCMAKE_CXX_FLAGS="-O3 -march=native" -DCMAKE_C_COMPILER=clang -DCMAKE_CXX_COMPILER=clang++ ..
make -j 8
sudo make install
sudo ldconfig

Fedora 33

After all other dependencies, need these in addition:

sudo dnf install gcc-c++ perl-FindBin

Needs /usr/local/lib, /usr/local/lib64 on ldconfig path:

sudo tee /etc/ld.so.conf.d/local.conf <<EOF
/usr/local/lib
/usr/local/lib64
EOF
sudo ldconfig

Alternative: MKL

On Ubuntu 20.04:

sudo apt install libmkl-dev
cmake -DUSE_CUDA=0 -DUSE_CUDNN=0 -DUSE_MKLDNN=1 -DUSE_CPP_PACKAGE=1 -DCMAKE_BUILD_TYPE=Release -DMKL_INCLUDE_DIR=/usr/include/mkl -GNinja ..

Compile kbot_mxnet jni

cd kbot_mxnet/jni
mkdir cmake-build-release
cd cmake-build-release
cmake -DCMAKE_BUILD_TYPE=Release -DCMAKE_C_FLAGS="-O3 -march=native" -DCMAKE_CXX_FLAGS="-O3 -march=native" -DCMAKE_C_COMPILER=clang -DCMAKE_CXX_COMPILER=clang++ ..
make -j 8
sudo make install

Places itself to /usr/java/packages/lib where java can pick it up without any other magic.

Uninstall kbot_mxnet (not provided for mxnet)

sudo make uninstall

Compile java package and place to maven local repo

cd kbot_mxnet
./gradlew clean test publishToMavenLocal --info

Run

Env vars

MXNET_SUBGRAPH_VERBOSE=0 switches off some annoying MXNet logging.

OMP_NUM_THREADS=1 better performance of smaller nets / single record inference.

NagyGa1/kbot_mxnet