Request Failed: Request Failed! Exception caught while generating caption.

[wjy3326]

when I upload some video files, I occured this issue.

the logs are here:
backend_1 | 172.14.0.3 - - [31/Dec/2020 10:32:11] "POST / HTTP/1.1" 200 -
frontend_1 | :
frontend_1 | File "/home/si/v2d/src/frontend/app.py", line 153, in upload_file
frontend_1 | output = json.loads(predict_fnames([filename]))
frontend_1 | File "/home/si/v2d/src/frontend/app.py", line 79, in predict_fnames
frontend_1 | return proxy.predict_fnames(fnames)
frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1243, in call
frontend_1 | return self.__send(self.__name, args)
frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1602, in __request
frontend_1 | verbose=self.__verbose
frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1283, in request
frontend_1 | return self.single_request(host, handler, request_body, verbose)
frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1308, in single_request
frontend_1 | self.send_request(h, handler, request_body)
frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1411, in send_request
frontend_1 | connection.putrequest("POST", handler, skip_accept_encoding=True)
frontend_1 | File "/usr/local/lib/python2.7/httplib.py", line 936, in putrequest
frontend_1 | raise CannotSendRequest()
frontend_1 | CannotSendRequest
frontend_1 |
frontend_1 | ImmutableMultiDict([('file', <FileStorage: u'video50.mp4' ('video/mp4')>)])
frontend_1 | File uploaded: /home/si/v2d/uploads/448043.mp4
frontend_1 | ImmutableMultiDict([('file', <FileStorage: u'video50.mp4' ('video/mp4')>)])
frontend_1 | File uploaded: /home/si/v2d/uploads/456732.mp4
frontend_1 | Traceback (most recent call last):
frontend_1 | File "/home/si/v2d/src/frontend/app.py", line 153, in upload_file
frontend_1 | output = json.loads(predict_fnames([filename]))
frontend_1 | File "/home/si/v2d/src/frontend/app.py", line 79, in predict_fnames
frontend_1 | return proxy.predict_fnames(fnames)
frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1243, in call
frontend_1 | return self.__send(self.__name, args)
frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1602, in __request
frontend_1 | verbose=self.__verbose
frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1283, in request
frontend_1 | return self.single_request(host, handler, request_body, verbose)
frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1308, in single_request
frontend_1 | self.send_request(h, handler, request_body)
frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1411, in send_request
frontend_1 | connection.putrequest("POST", handler, skip_accept_encoding=True)
frontend_1 | File "/usr/local/lib/python2.7/httplib.py", line 936, in putrequest
frontend_1 | raise CannotSendRequest()
frontend_1 | CannotSendRequest
frontend_1 |
frontend_1 | ImmutableMultiDict([('file', <FileStorage: u'video50.mp4' ('video/mp4')>)])
frontend_1 | File uploaded: /home/si/v2d/uploads/33366.mp4
frontend_1 | ImmutableMultiDict([('file', <FileStorage: u'video1.mp4' ('video/mp4')>)])
frontend_1 | File uploaded: /home/si/v2d/uploads/833364.mp4
frontend_1 | ImmutableMultiDict([('file', <FileStorage: u'video5.mp4' ('video/mp4')>)])
frontend_1 | File uploaded: /home/si/v2d/uploads/563627.mp4
frontend_1 | Traceback (most recent call last):
frontend_1 | File "/home/si/v2d/src/frontend/app.py", line 153, in upload_file
frontend_1 | output = json.loads(predict_fnames([filename]))
frontend_1 | File "/home/si/v2d/src/frontend/app.py", line 79, in predict_fnames
frontend_1 | return proxy.predict_fnames(fnames)
frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1243, in call
frontend_1 | return self.__send(self.__name, args)
frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1602, in __request
frontend_1 | verbose=self.__verbose
frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1283, in request
frontend_1 | return self.single_request(host, handler, request_body, verbose)
frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1316, in single_request
frontend_1 | return self.parse_response(response)
frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 1493, in parse_response
frontend_1 | return u.close()
frontend_1 | File "/usr/local/lib/python2.7/xmlrpclib.py", line 800, in close
frontend_1 | raise Fault(**self._stack[0])
frontend_1 | Fault: <Fault 1: "<class 'audioread.exceptions.NoBackendError'>:">
frontend_1 |
frontend_1 | ImmutableMultiDict([('file', <FileStorage: u'video1.mp4' ('video/mp4')>)])
frontend_1 | File uploaded: /home/si/v2d/uploads/278568.mp4
frontend_1 | ImmutableMultiDict([('file', <FileStorage: u'video5.mp4' ('video/mp4')>)])
frontend_1 | File uploaded: /home/si/v2d/uploads/753145.mp4
frontend_1 | Traceback (most recent call last):
frontend_1 | File "/home/si/v2d/src/frontend/app.py", line 153, in upload_file
frontend_1 | output = json.loads(predict_fnames([filename]))
frontend_1 | File "/home/si/v2d/src/frontend/app.py", line 79, in predict_fnames
backend_1 | 172.14.0.3 - - [31/Dec/2020 10:42:39] "POST / HTTP/1.1" 200 -
backend_1 | [framework.py:242 - predict_fnames() ] Trying to predict for ['/home/si/v2d/uploads/838295.mp4']

[scopeInfinity]

Thanks for filing the issue. The audioread.exceptions.NoBackendError exception seems to be raised on the video processing side.

Will it be possible for you to provide a bit more details related to the following?

• Host OS?
• Was the application running inside docker? Or build from scratch?
• Is the error reproducible? Or was it one time?
  • Will it is possible to rerun the service again using docker-compose and give extra time before uploading the video? Do we still see the same error?
• Is the error visible only on a set of videos? or all?
• Will it is possible to share a sample video where the captioning is not working for testing, only if it's ok.

[wjy3326]

I run the service use docker-compose in my linux server. It is normal when I use postman to access the service. The above problem occurs when I use the webpage to visit, basically all videos can't get results. When I execute without Docker and download the pretrained model and turn up the backend to deploy the service on my server, another error occurred, as follows, how can I fix it? Thanks.

Total params: 62,387,240
Trainable params: 62,384,808
Non-trainable params: 2,432

---

[model.py:132 - build_mcnn() ] Model Created ResNet_D512L512_G128G64_D1024D0.25BN_BDGRU1024_D0.2L1024DVS
2021-01-02 19:34:48.450666: I tensorflow/core/platform/cpu_feature_guard.cc:137] Your CPU supports instructions that this TensorFlow binary was not compiled to use: SSE4.1 SSE4.2 AVX AVX2 FMA
2021-01-02 19:34:49.018159: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1105] Found device 0 with properties:
name: GeForce GTX 1080 Ti major: 6 minor: 1 memoryClockRate(GHz): 1.582
pciBusID: 0000:05:00.0
totalMemory: 10.92GiB freeMemory: 10.57GiB
2021-01-02 19:34:49.018262: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1195] Creating TensorFlow device (/device:GPU:0) -> (device: 0, name: GeForce GTX 1080 Ti, pci bus id: 0000:05:00.0, compute capability: 6.1)
[model.py:41 - build_cutoffmodel() ] Building Cutoff Model

---

Layer (type) Output Shape Param # Connected to

input_1 (InputLayer) (None, None, None, 3) 0

---

conv1 (Conv2D) (None, None, None, 64 9472 input_1[0][0]

---

bn_conv1 (BatchNormalization) (None, None, None, 64 256 conv1[0][0]

---

activation_3 (Activation) (None, None, None, 64 0 bn_conv1[0][0]

---

max_pooling2d_1 (MaxPooling2D) (None, None, None, 64 0 activation_3[0][0]

---

res2a_branch2a (Conv2D) (None, None, None, 64 4160 max_pooling2d_1[0][0]

---

bn2a_branch2a (BatchNormalizatio (None, None, None, 64 256 res2a_branch2a[0][0]

---

activation_4 (Activation) (None, None, None, 64 0 bn2a_branch2a[0][0]

---

res2a_branch2b (Conv2D) (None, None, None, 64 36928 activation_4[0][0]

---

bn2a_branch2b (BatchNormalizatio (None, None, None, 64 256 res2a_branch2b[0][0]

---

activation_5 (Activation) (None, None, None, 64 0 bn2a_branch2b[0][0]

---

res2a_branch2c (Conv2D) (None, None, None, 25 16640 activation_5[0][0]

---

res2a_branch1 (Conv2D) (None, None, None, 25 16640 max_pooling2d_1[0][0]

---

bn2a_branch2c (BatchNormalizatio (None, None, None, 25 1024 res2a_branch2c[0][0]

---

bn2a_branch1 (BatchNormalization (None, None, None, 25 1024 res2a_branch1[0][0]

---

add_1 (Add) (None, None, None, 25 0 bn2a_branch2c[0][0]
bn2a_branch1[0][0]

---

activation_6 (Activation) (None, None, None, 25 0 add_1[0][0]

---

res2b_branch2a (Conv2D) (None, None, None, 64 16448 activation_6[0][0]

---

bn2b_branch2a (BatchNormalizatio (None, None, None, 64 256 res2b_branch2a[0][0]

---

activation_7 (Activation) (None, None, None, 64 0 bn2b_branch2a[0][0]

---

res2b_branch2b (Conv2D) (None, None, None, 64 36928 activation_7[0][0]

---

bn2b_branch2b (BatchNormalizatio (None, None, None, 64 256 res2b_branch2b[0][0]

---

activation_8 (Activation) (None, None, None, 64 0 bn2b_branch2b[0][0]

---

res2b_branch2c (Conv2D) (None, None, None, 25 16640 activation_8[0][0]

---

bn2b_branch2c (BatchNormalizatio (None, None, None, 25 1024 res2b_branch2c[0][0]

---

add_2 (Add) (None, None, None, 25 0 bn2b_branch2c[0][0]
activation_6[0][0]

---

activation_9 (Activation) (None, None, None, 25 0 add_2[0][0]

---

res2c_branch2a (Conv2D) (None, None, None, 64 16448 activation_9[0][0]

---

bn2c_branch2a (BatchNormalizatio (None, None, None, 64 256 res2c_branch2a[0][0]

---

activation_10 (Activation) (None, None, None, 64 0 bn2c_branch2a[0][0]

---

res2c_branch2b (Conv2D) (None, None, None, 64 36928 activation_10[0][0]

---

bn2c_branch2b (BatchNormalizatio (None, None, None, 64 256 res2c_branch2b[0][0]

---

activation_11 (Activation) (None, None, None, 64 0 bn2c_branch2b[0][0]

---

res2c_branch2c (Conv2D) (None, None, None, 25 16640 activation_11[0][0]

---

bn2c_branch2c (BatchNormalizatio (None, None, None, 25 1024 res2c_branch2c[0][0]

---

add_3 (Add) (None, None, None, 25 0 bn2c_branch2c[0][0]
activation_9[0][0]

---

activation_12 (Activation) (None, None, None, 25 0 add_3[0][0]

---

res3a_branch2a (Conv2D) (None, None, None, 12 32896 activation_12[0][0]

---

bn3a_branch2a (BatchNormalizatio (None, None, None, 12 512 res3a_branch2a[0][0]

---

activation_13 (Activation) (None, None, None, 12 0 bn3a_branch2a[0][0]

---

res3a_branch2b (Conv2D) (None, None, None, 12 147584 activation_13[0][0]

---

bn3a_branch2b (BatchNormalizatio (None, None, None, 12 512 res3a_branch2b[0][0]

---

activation_14 (Activation) (None, None, None, 12 0 bn3a_branch2b[0][0]

---

res3a_branch2c (Conv2D) (None, None, None, 51 66048 activation_14[0][0]

---

res3a_branch1 (Conv2D) (None, None, None, 51 131584 activation_12[0][0]

---

bn3a_branch2c (BatchNormalizatio (None, None, None, 51 2048 res3a_branch2c[0][0]

---

bn3a_branch1 (BatchNormalization (None, None, None, 51 2048 res3a_branch1[0][0]

---

add_4 (Add) (None, None, None, 51 0 bn3a_branch2c[0][0]
bn3a_branch1[0][0]

---

activation_15 (Activation) (None, None, None, 51 0 add_4[0][0]

---

res3b_branch2a (Conv2D) (None, None, None, 12 65664 activation_15[0][0]

---

bn3b_branch2a (BatchNormalizatio (None, None, None, 12 512 res3b_branch2a[0][0]

---

activation_16 (Activation) (None, None, None, 12 0 bn3b_branch2a[0][0]

---

res3b_branch2b (Conv2D) (None, None, None, 12 147584 activation_16[0][0]

---

bn3b_branch2b (BatchNormalizatio (None, None, None, 12 512 res3b_branch2b[0][0]

---

activation_17 (Activation) (None, None, None, 12 0 bn3b_branch2b[0][0]

---

res3b_branch2c (Conv2D) (None, None, None, 51 66048 activation_17[0][0]

---

bn3b_branch2c (BatchNormalizatio (None, None, None, 51 2048 res3b_branch2c[0][0]

---

add_5 (Add) (None, None, None, 51 0 bn3b_branch2c[0][0]
activation_15[0][0]

---

activation_18 (Activation) (None, None, None, 51 0 add_5[0][0]

---

res3c_branch2a (Conv2D) (None, None, None, 12 65664 activation_18[0][0]

---

bn3c_branch2a (BatchNormalizatio (None, None, None, 12 512 res3c_branch2a[0][0]

---

activation_19 (Activation) (None, None, None, 12 0 bn3c_branch2a[0][0]

---

res3c_branch2b (Conv2D) (None, None, None, 12 147584 activation_19[0][0]

---

bn3c_branch2b (BatchNormalizatio (None, None, None, 12 512 res3c_branch2b[0][0]

---

activation_20 (Activation) (None, None, None, 12 0 bn3c_branch2b[0][0]

---

res3c_branch2c (Conv2D) (None, None, None, 51 66048 activation_20[0][0]

---

bn3c_branch2c (BatchNormalizatio (None, None, None, 51 2048 res3c_branch2c[0][0]

---

add_6 (Add) (None, None, None, 51 0 bn3c_branch2c[0][0]
activation_18[0][0]

---

activation_21 (Activation) (None, None, None, 51 0 add_6[0][0]

---

res3d_branch2a (Conv2D) (None, None, None, 12 65664 activation_21[0][0]

---

bn3d_branch2a (BatchNormalizatio (None, None, None, 12 512 res3d_branch2a[0][0]

---

activation_22 (Activation) (None, None, None, 12 0 bn3d_branch2a[0][0]

---

res3d_branch2b (Conv2D) (None, None, None, 12 147584 activation_22[0][0]

---

bn3d_branch2b (BatchNormalizatio (None, None, None, 12 512 res3d_branch2b[0][0]

---

activation_23 (Activation) (None, None, None, 12 0 bn3d_branch2b[0][0]

---

res3d_branch2c (Conv2D) (None, None, None, 51 66048 activation_23[0][0]

---

bn3d_branch2c (BatchNormalizatio (None, None, None, 51 2048 res3d_branch2c[0][0]

---

add_7 (Add) (None, None, None, 51 0 bn3d_branch2c[0][0]
activation_21[0][0]

---

activation_24 (Activation) (None, None, None, 51 0 add_7[0][0]

---

res4a_branch2a (Conv2D) (None, None, None, 25 131328 activation_24[0][0]

---

bn4a_branch2a (BatchNormalizatio (None, None, None, 25 1024 res4a_branch2a[0][0]

---

activation_25 (Activation) (None, None, None, 25 0 bn4a_branch2a[0][0]

---

res4a_branch2b (Conv2D) (None, None, None, 25 590080 activation_25[0][0]

---

bn4a_branch2b (BatchNormalizatio (None, None, None, 25 1024 res4a_branch2b[0][0]

---

activation_26 (Activation) (None, None, None, 25 0 bn4a_branch2b[0][0]

---

res4a_branch2c (Conv2D) (None, None, None, 10 263168 activation_26[0][0]

---

res4a_branch1 (Conv2D) (None, None, None, 10 525312 activation_24[0][0]

---

bn4a_branch2c (BatchNormalizatio (None, None, None, 10 4096 res4a_branch2c[0][0]

---

bn4a_branch1 (BatchNormalization (None, None, None, 10 4096 res4a_branch1[0][0]

---

add_8 (Add) (None, None, None, 10 0 bn4a_branch2c[0][0]
bn4a_branch1[0][0]

---

activation_27 (Activation) (None, None, None, 10 0 add_8[0][0]

---

res4b_branch2a (Conv2D) (None, None, None, 25 262400 activation_27[0][0]

---

bn4b_branch2a (BatchNormalizatio (None, None, None, 25 1024 res4b_branch2a[0][0]

---

activation_28 (Activation) (None, None, None, 25 0 bn4b_branch2a[0][0]

---

res4b_branch2b (Conv2D) (None, None, None, 25 590080 activation_28[0][0]

---

bn4b_branch2b (BatchNormalizatio (None, None, None, 25 1024 res4b_branch2b[0][0]

---

activation_29 (Activation) (None, None, None, 25 0 bn4b_branch2b[0][0]

---

res4b_branch2c (Conv2D) (None, None, None, 10 263168 activation_29[0][0]

---

bn4b_branch2c (BatchNormalizatio (None, None, None, 10 4096 res4b_branch2c[0][0]

---

add_9 (Add) (None, None, None, 10 0 bn4b_branch2c[0][0]
activation_27[0][0]

---

activation_30 (Activation) (None, None, None, 10 0 add_9[0][0]

---

res4c_branch2a (Conv2D) (None, None, None, 25 262400 activation_30[0][0]

---

bn4c_branch2a (BatchNormalizatio (None, None, None, 25 1024 res4c_branch2a[0][0]

---

activation_31 (Activation) (None, None, None, 25 0 bn4c_branch2a[0][0]

---

res4c_branch2b (Conv2D) (None, None, None, 25 590080 activation_31[0][0]

---

bn4c_branch2b (BatchNormalizatio (None, None, None, 25 1024 res4c_branch2b[0][0]

---

activation_32 (Activation) (None, None, None, 25 0 bn4c_branch2b[0][0]

---

res4c_branch2c (Conv2D) (None, None, None, 10 263168 activation_32[0][0]

---

bn4c_branch2c (BatchNormalizatio (None, None, None, 10 4096 res4c_branch2c[0][0]

---

add_10 (Add) (None, None, None, 10 0 bn4c_branch2c[0][0]
activation_30[0][0]

---

activation_33 (Activation) (None, None, None, 10 0 add_10[0][0]

---

res4d_branch2a (Conv2D) (None, None, None, 25 262400 activation_33[0][0]

---

bn4d_branch2a (BatchNormalizatio (None, None, None, 25 1024 res4d_branch2a[0][0]

---

activation_34 (Activation) (None, None, None, 25 0 bn4d_branch2a[0][0]

---

res4d_branch2b (Conv2D) (None, None, None, 25 590080 activation_34[0][0]

---

bn4d_branch2b (BatchNormalizatio (None, None, None, 25 1024 res4d_branch2b[0][0]

---

activation_35 (Activation) (None, None, None, 25 0 bn4d_branch2b[0][0]

---

res4d_branch2c (Conv2D) (None, None, None, 10 263168 activation_35[0][0]

---

bn4d_branch2c (BatchNormalizatio (None, None, None, 10 4096 res4d_branch2c[0][0]

---

add_11 (Add) (None, None, None, 10 0 bn4d_branch2c[0][0]
activation_33[0][0]

---

activation_36 (Activation) (None, None, None, 10 0 add_11[0][0]

---

res4e_branch2a (Conv2D) (None, None, None, 25 262400 activation_36[0][0]

---

bn4e_branch2a (BatchNormalizatio (None, None, None, 25 1024 res4e_branch2a[0][0]

---

activation_37 (Activation) (None, None, None, 25 0 bn4e_branch2a[0][0]

---

res4e_branch2b (Conv2D) (None, None, None, 25 590080 activation_37[0][0]

---

bn4e_branch2b (BatchNormalizatio (None, None, None, 25 1024 res4e_branch2b[0][0]

---

activation_38 (Activation) (None, None, None, 25 0 bn4e_branch2b[0][0]

---

res4e_branch2c (Conv2D) (None, None, None, 10 263168 activation_38[0][0]

---

bn4e_branch2c (BatchNormalizatio (None, None, None, 10 4096 res4e_branch2c[0][0]

---

add_12 (Add) (None, None, None, 10 0 bn4e_branch2c[0][0]
activation_36[0][0]

---

activation_39 (Activation) (None, None, None, 10 0 add_12[0][0]

---

res4f_branch2a (Conv2D) (None, None, None, 25 262400 activation_39[0][0]

---

bn4f_branch2a (BatchNormalizatio (None, None, None, 25 1024 res4f_branch2a[0][0]

---

activation_40 (Activation) (None, None, None, 25 0 bn4f_branch2a[0][0]

---

res4f_branch2b (Conv2D) (None, None, None, 25 590080 activation_40[0][0]

---

bn4f_branch2b (BatchNormalizatio (None, None, None, 25 1024 res4f_branch2b[0][0]

---

activation_41 (Activation) (None, None, None, 25 0 bn4f_branch2b[0][0]

---

res4f_branch2c (Conv2D) (None, None, None, 10 263168 activation_41[0][0]

---

bn4f_branch2c (BatchNormalizatio (None, None, None, 10 4096 res4f_branch2c[0][0]

---

add_13 (Add) (None, None, None, 10 0 bn4f_branch2c[0][0]
activation_39[0][0]

---

activation_42 (Activation) (None, None, None, 10 0 add_13[0][0]

---

res5a_branch2a (Conv2D) (None, None, None, 51 524800 activation_42[0][0]

---

bn5a_branch2a (BatchNormalizatio (None, None, None, 51 2048 res5a_branch2a[0][0]

---

activation_43 (Activation) (None, None, None, 51 0 bn5a_branch2a[0][0]

---

res5a_branch2b (Conv2D) (None, None, None, 51 2359808 activation_43[0][0]

---

bn5a_branch2b (BatchNormalizatio (None, None, None, 51 2048 res5a_branch2b[0][0]

---

activation_44 (Activation) (None, None, None, 51 0 bn5a_branch2b[0][0]

---

res5a_branch2c (Conv2D) (None, None, None, 20 1050624 activation_44[0][0]

---

res5a_branch1 (Conv2D) (None, None, None, 20 2099200 activation_42[0][0]

---

bn5a_branch2c (BatchNormalizatio (None, None, None, 20 8192 res5a_branch2c[0][0]

---

bn5a_branch1 (BatchNormalization (None, None, None, 20 8192 res5a_branch1[0][0]

---

add_14 (Add) (None, None, None, 20 0 bn5a_branch2c[0][0]
bn5a_branch1[0][0]

---

activation_45 (Activation) (None, None, None, 20 0 add_14[0][0]

---

res5b_branch2a (Conv2D) (None, None, None, 51 1049088 activation_45[0][0]

---

bn5b_branch2a (BatchNormalizatio (None, None, None, 51 2048 res5b_branch2a[0][0]

---

activation_46 (Activation) (None, None, None, 51 0 bn5b_branch2a[0][0]

---

res5b_branch2b (Conv2D) (None, None, None, 51 2359808 activation_46[0][0]

---

bn5b_branch2b (BatchNormalizatio (None, None, None, 51 2048 res5b_branch2b[0][0]

---

activation_47 (Activation) (None, None, None, 51 0 bn5b_branch2b[0][0]

---

res5b_branch2c (Conv2D) (None, None, None, 20 1050624 activation_47[0][0]

---

bn5b_branch2c (BatchNormalizatio (None, None, None, 20 8192 res5b_branch2c[0][0]

---

add_15 (Add) (None, None, None, 20 0 bn5b_branch2c[0][0]
activation_45[0][0]

---

activation_48 (Activation) (None, None, None, 20 0 add_15[0][0]

---

res5c_branch2a (Conv2D) (None, None, None, 51 1049088 activation_48[0][0]

---

bn5c_branch2a (BatchNormalizatio (None, None, None, 51 2048 res5c_branch2a[0][0]

---

activation_49 (Activation) (None, None, None, 51 0 bn5c_branch2a[0][0]

---

res5c_branch2b (Conv2D) (None, None, None, 51 2359808 activation_49[0][0]

---

bn5c_branch2b (BatchNormalizatio (None, None, None, 51 2048 res5c_branch2b[0][0]

---

activation_50 (Activation) (None, None, None, 51 0 bn5c_branch2b[0][0]

---

res5c_branch2c (Conv2D) (None, None, None, 20 1050624 activation_50[0][0]

---

bn5c_branch2c (BatchNormalizatio (None, None, None, 20 8192 res5c_branch2c[0][0]

---

add_16 (Add) (None, None, None, 20 0 bn5c_branch2c[0][0]
activation_48[0][0]

---

activation_51 (Activation) (None, None, None, 20 0 add_16[0][0]

---

avg_pool (AveragePooling2D) (None, None, None, 20 0 activation_51[0][0]

Total params: 23,587,712
Trainable params: 23,534,592
Non-trainable params: 53,120

---

[model.py:47 - build_cutoffmodel() ] Building Cutoff Model : Completed
[framework.py:137 - load() ] Model Path: models/ResNet_D512L512_G128G64_D1024D0.20BN_BDGRU1024_D0.2L1024DVS_model.dat_4981_loss_2.471_Cider0.355_Blue0.337_Rouge0.568_Meteor0.249
[framework.py:141 - load() ] Weights Loaded
[framework.py:127 - init() ] init framework complete

• Serving Flask app "parser" (lazy loading)
• Environment: production
  WARNING: This is a development server. Do not use it in a production deployment.
  Use a production WSGI server instead.
• Debug mode: off
  [_internal.py:113 - _log() ] * Running on http://0.0.0.0:4888/ (Press CTRL+C to quit)
  ImmutableMultiDict([('file', <FileStorage: 'video1.mp4' ('video/mp4')>)])
  File uploaded: uploads/786489.mp4
  [parser.py:50 - predict_fnames() ] Trying to predict for ['uploads/786489.mp4']
  /u01/isi/wangjunyan/envs/tensorflow_1.2/lib64/python3.6/site-packages/librosa/core/audio.py:162: UserWarning: PySoundFile failed. Trying audioread instead.
  warnings.warn("PySoundFile failed. Trying audioread instead.")
  [framework.py:206 - predict_model_direct() ] Predicting for Videos :-
  ['uploads/786489.mp4']
  [framework.py:213 - predict_model_direct() ] Shape of Caption : (1, 16, 300)
  Traceback (most recent call last):
  File "/u01/isi/wangjunyan/video_captioning/Video2Description/src/backend/parser.py", line 86, in upload_file
  output = json.loads(predict_fnames(framework, [filename]))
  File "/u01/isi/wangjunyan/video_captioning/Video2Description/src/backend/parser.py", line 51, in predict_fnames
  result = framework.predict_model(fnames=fnames)
  File "/u01/isi/wangjunyan/video_captioning/Video2Description/src/backend/framework.py", line 266, in predict_model
  pred,out = self.predict_model_direct(fnames[i*batch_size:(i+1)*batch_size], cache_ids = cids)
  File "/u01/isi/wangjunyan/video_captioning/Video2Description/src/backend/framework.py", line 218, in predict_model_direct
  newOneHotCap = self.model.predict([embeddedCap, audioVecs, videoVecs])
  File "/u01/isi/wangjunyan/envs/tensorflow_1.2/lib64/python3.6/site-packages/keras/models.py", line 913, in predict
  return self.model.predict(x, batch_size=batch_size, verbose=verbose)
  File "/u01/isi/wangjunyan/envs/tensorflow_1.2/lib64/python3.6/site-packages/keras/engine/training.py", line 1710, in predict
  self._make_predict_function()
  File "/u01/isi/wangjunyan/envs/tensorflow_1.2/lib64/python3.6/site-packages/keras/engine/training.py", line 999, in _make_predict_function
  **kwargs)
  File "/u01/isi/wangjunyan/envs/tensorflow_1.2/lib64/python3.6/site-packages/keras/backend/tensorflow_backend.py", line 2297, in function
  return Function(inputs, outputs, updates=updates, **kwargs)
  File "/u01/isi/wangjunyan/envs/tensorflow_1.2/lib64/python3.6/site-packages/keras/backend/tensorflow_backend.py", line 2246, in init
  with tf.control_dependencies(self.outputs):
  File "/u01/isi/wangjunyan/envs/tensorflow_1.2/lib64/python3.6/site-packages/tensorflow/python/framework/ops.py", line 4604, in control_dependencies
  return get_default_graph().control_dependencies(control_inputs)
  File "/u01/isi/wangjunyan/envs/tensorflow_1.2/lib64/python3.6/site-packages/tensorflow/python/framework/ops.py", line 4310, in control_dependencies
  c = self.as_graph_element(c)
  File "/u01/isi/wangjunyan/envs/tensorflow_1.2/lib64/python3.6/site-packages/tensorflow/python/framework/ops.py", line 3323, in as_graph_element
  return self._as_graph_element_locked(obj, allow_tensor, allow_operation)
  File "/u01/isi/wangjunyan/envs/tensorflow_1.2/lib64/python3.6/site-packages/tensorflow/python/framework/ops.py", line 3402, in _as_graph_element_locked
  raise ValueError("Tensor %s is not an element of this graph." % obj)
  ValueError: Tensor Tensor("activation_2/truediv:0", shape=(?, 16, 9448), dtype=float32) is not an element of this graph.

[_internal.py:113 - _log() ] 192.168.10.250 - - [02/Jan/2021 19:35:04] "POST /upload HTTP/1.1" 200 -

[github-actions]

Is follow-up required?