[Question] Does the DLC engine only have one output?
Closed this issue · 2 comments
Carl-2008 commented
Describe the bug
I exported a whisper encoder model with two outputs, n_layer_cross_k and n_layer_cross_v. However, after converting it to a dlc model using Ai Engine Direct and reasoning with the snpe engine, there is only one output.
To Reproduce
Steps to reproduce the behavior:
- Script from https://github.com/k2-fsa/sherpa-onnx/tree/master/scripts/whisper
- export tiny.en encoder and onverting it to a dlc
- run dlc model
- See error
SNPE.NeuralNetworkBuilder builder = new SNPE.NeuralNetworkBuilder(application)
.setRuntimeOrder(AIP, CPU).setModel(new File(model_path));
NeuralNetwork network = builder.build();
FloatTensor tensor = network.createFloatTensor(1, 3000, 80);
tensor.write(da, 0, da.length);
final Map<String, FloatTensor> inputsMap = new HashMap<>();
inputsMap.put("mel", tensor);
Map<String, FloatTensor> outputsMap = network.execute(inputsMap);
Expected behavior
give me 2 outputs, but only one(n_layer_cross_v)
mestrona-3 commented
Hi @Carl-2008 , AI Hub currently doesn't support .dlc format, we support only QNN, TFLite, and ONNX. We'd suggested bringing any SNPE related questions to the Qualcomm Discord https://discord.gg/TzvP3JhfzX
Carl-2008 commented
okay