spotify/zoltar

Accept `tf.Tensor` for TensorFlow prediction?

alum opened this issue · 0 comments

alum commented

For TensorFlow models, the conversion from tf.Example to tf.Tensor is a CPU/allocation intensive operation. Would it be possible to supply an API that accepts tf.Tensor as input?

More specifically I'm referring to this conversion: https://github.com/spotify/zoltar/blob/master/zoltar-tensorflow/src/main/java/com/spotify/zoltar/tf/TensorFlowPredictFn.java#L97