LOADING A TORCHSCRIPT MODEL IN C++
The following repositories will outline the path PyTorch provides to go from an existing Python model to a serialized representation that can be loaded and executed purely from C++, with no dependency on Python. Provided in 4 simple steps.
As its name suggests, the primary interface is PyTorch- a Python programming language.
While Python is a suitable and the preferred language for many scenarios requiring dynamism and ease of iteration, there are equally many situations where precisely these properties of Python are unfavorable. One environment in which the latter often applies is production – the land of low latencies and strict deployment requirements.
For production scenarios, C++ is most often the language of choice, even if only to bind it into other languages like Java, Rust, or Go.
Created and Released for research and development - Justin Mitchell 2021