Accept `tf.Tensor` for TensorFlow prediction?
alum opened this issue · 0 comments
alum commented
For TensorFlow models, the conversion from tf.Example
to tf.Tensor
is a CPU/allocation intensive operation. Would it be possible to supply an API that accepts tf.Tensor
as input?
More specifically I'm referring to this conversion: https://github.com/spotify/zoltar/blob/master/zoltar-tensorflow/src/main/java/com/spotify/zoltar/tf/TensorFlowPredictFn.java#L97