Transformer model inference result is different with TFLite Micro kernel
Opened this issue · 3 comments
solderzzc commented
@gregory-bronstain
Have you deployed transformer to TFLite micro kernel? I found that the model has different inference result with TFLite Mirco kernel than TFLite kernel with Python interface.
I also posted an issue to Tflite micro repo: tensorflow/tflite-micro#960 (comment)
gregory-bronstain commented
Hi
I didn’t recall such deployment, no
FYI Our department was moved from ML as around few months ago…
Could you please find someone who support it and could help you more efficiently?
Regards, Greg
From: Simba Zhang ***@***.***>
Sent: Monday, November 14, 2022 8:06 PM
To: ARM-software/ML-zoo ***@***.***>
Cc: Gregory Bronstain ***@***.***>; Mention ***@***.***>
Subject: [ARM-software/ML-zoo] Transformer model inference result is different with TFLite Micro kernel (Issue #54)
@gregory-bronstain<https://github.com/gregory-bronstain>
Have you deployed transformer to TFLite micro kernel? I found that the model has different inference result with TFLite Mirco kernel than TFLite kernel with Python interface.
I also posted an issue to Tflite micro repo: tensorflow/tflite-micro#960 (comment)<tensorflow/tflite-micro#960 (comment)>
—
Reply to this email directly, view it on GitHub<#54>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AU7RMU2CEOXDQFL4L23R6HDWIJ5QTANCNFSM6AAAAAASAC4TUI>.
You are receiving this because you were mentioned.Message ID: ***@***.******@***.***>>
IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Thank you.
gregory-bronstain commented
Hi.
Additionally, to my knowledge the responsible person is @Konstantinos ***@***.***>
Regards, Greg
From: Gregory Bronstain
Sent: Tuesday, November 15, 2022 9:10 AM
To: ARM-software/ML-zoo ***@***.***>
Subject: RE: [ARM-software/ML-zoo] Transformer model inference result is different with TFLite Micro kernel (Issue #54)
Hi
I didn’t recall such deployment, no
FYI Our department was moved from ML as around few months ago…
Could you please find someone who support it and could help you more efficiently?
Regards, Greg
From: Simba Zhang ***@***.******@***.***>>
Sent: Monday, November 14, 2022 8:06 PM
To: ARM-software/ML-zoo ***@***.******@***.***>>
Cc: Gregory Bronstain ***@***.******@***.***>>; Mention ***@***.******@***.***>>
Subject: [ARM-software/ML-zoo] Transformer model inference result is different with TFLite Micro kernel (Issue #54)
@gregory-bronstain<https://github.com/gregory-bronstain>
Have you deployed transformer to TFLite micro kernel? I found that the model has different inference result with TFLite Mirco kernel than TFLite kernel with Python interface.
I also posted an issue to Tflite micro repo: tensorflow/tflite-micro#960 (comment)<tensorflow/tflite-micro#960 (comment)>
—
Reply to this email directly, view it on GitHub<#54>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AU7RMU2CEOXDQFL4L23R6HDWIJ5QTANCNFSM6AAAAAASAC4TUI>.
You are receiving this because you were mentioned.Message ID: ***@***.******@***.***>>
IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Thank you.
gregory-bronstain commented
Hi,
I am afraid we haven't deployed any network other than DS-CNN using TFLu.
In case it's helpful we have a documentation here : https://confluence.arm.com/display/MLTECH/TensorFlow+Lite+for+Microcontrollers+-+How+It+Works that covers various topics with respect to TFLu. Please also check the subpages in case you find something interesting with respect to the deployment flow,
Thanks,
Konstantinos.
…________________________________
From: Gregory Bronstain ***@***.***>
Sent: 15 November 2022 07:25
To: ARM-software/ML-zoo ***@***.***>; Konstantinos Monachopoulos ***@***.***>
Subject: RE: [ARM-software/ML-zoo] Transformer model inference result is different with TFLite Micro kernel (Issue #54)
Hi.
Additionally, to my knowledge the responsible person is @Konstantinos ***@***.***>
Regards, Greg
From: Gregory Bronstain
Sent: Tuesday, November 15, 2022 9:10 AM
To: ARM-software/ML-zoo ***@***.***>
Subject: RE: [ARM-software/ML-zoo] Transformer model inference result is different with TFLite Micro kernel (Issue #54)
Hi
I didn’t recall such deployment, no
FYI Our department was moved from ML as around few months ago…
Could you please find someone who support it and could help you more efficiently?
Regards, Greg
From: Simba Zhang ***@***.******@***.***>>
Sent: Monday, November 14, 2022 8:06 PM
To: ARM-software/ML-zoo ***@***.******@***.***>>
Cc: Gregory Bronstain ***@***.******@***.***>>; Mention ***@***.******@***.***>>
Subject: [ARM-software/ML-zoo] Transformer model inference result is different with TFLite Micro kernel (Issue #54)
@gregory-bronstain<https://github.com/gregory-bronstain>
Have you deployed transformer to TFLite micro kernel? I found that the model has different inference result with TFLite Mirco kernel than TFLite kernel with Python interface.
I also posted an issue to Tflite micro repo: tensorflow/tflite-micro#960 (comment)<tensorflow/tflite-micro#960 (comment)>
—
Reply to this email directly, view it on GitHub<#54>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AU7RMU2CEOXDQFL4L23R6HDWIJ5QTANCNFSM6AAAAAASAC4TUI>.
You are receiving this because you were mentioned.Message ID: ***@***.******@***.***>>
IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Thank you.