How to solve this problem?
Opened this issue · 7 comments
sunqing-code commented
kimkyeonghun commented
Can you show me train_data structure?
sunqing-code commented
I use the dataset downloaded from https://github.com/pliang279/MultiBench.
In the mosei_raw.pkl file, some of the data is as follows:
{'train': {'vision': array([[[0.00000000e+00, 8.42833328e+01, 9.79999781e-01, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [0.00000000e+00, 8.47666931e+01, 9.79999840e-01, ..., 0.00000000e+00, 0.00000000e+00, 4.61538464e-01], [0.00000000e+00, 8.51333618e+01, 9.79999900e-01, ..., 0.00000000e+00, 0.00000000e+00, 4.54545468e-01], ..., [0.00000000e+00, 9.93833694e+01, 9.80000019e-01, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [0.00000000e+00, 9.97833252e+01, 9.79999781e-01, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [0.00000000e+00, 1.00450005e+02, 9.79999721e-01, ..., 0.00000000e+00, 0.00000000e+00, 1.66666672e-01]], [[0.00000000e+00, 0.00000000e+00, 0.00000000e+00, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [0.00000000e+00, 0.00000000e+00, 0.00000000e+00, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [0.00000000e+00, 0.00000000e+00, 0.00000000e+00, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], ..., [0.00000000e+00, 1.24433342e+02, 9.80000019e-01, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [0.00000000e+00, 1.24633369e+02, 9.79999900e-01, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [0.00000000e+00, 1.25116653e+02, 9.79999721e-01, ..., 0.00000000e+00, 0.00000000e+00, 1.00000001e-01]], [[0.00000000e+00, 0.00000000e+00, 0.00000000e+00, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [0.00000000e+00, 0.00000000e+00, 0.00000000e+00, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [0.00000000e+00, 0.00000000e+00, 0.00000000e+00, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], ..., [0.00000000e+00, 1.32500000e+01, 9.79999721e-01, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [0.00000000e+00, 1.36500006e+01, 9.80000019e-01, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [0.00000000e+00, 1.41000023e+01, 9.79999721e-01, ..., 0.00000000e+00, 0.00000000e+00, 3.04347813e-01]], ..., [[0.00000000e+00, 0.00000000e+00, 0.00000000e+00, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [0.00000000e+00, 0.00000000e+00, 0.00000000e+00, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [0.00000000e+00, 0.00000000e+00, 0.00000000e+00, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], ..., [0.00000000e+00, 4.80667114e+01, 9.80000019e-01, ..., 2.85714298e-01, 0.00000000e+00, 0.00000000e+00], [0.00000000e+00, 4.82334023e+01, 9.60000038e-01, ..., 1.00000000e+00, 0.00000000e+00, 0.00000000e+00], [0.00000000e+00, 4.83999977e+01, 9.80000019e-01, ..., 4.28571433e-01, 0.00000000e+00, 1.42857149e-01]], [[0.00000000e+00, 0.00000000e+00, 0.00000000e+00, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [0.00000000e+00, 0.00000000e+00, 0.00000000e+00, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [0.00000000e+00, 0.00000000e+00, 0.00000000e+00, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], ..., [0.00000000e+00, 4.89332848e+01, 9.80000019e-01, ..., 0.00000000e+00, 0.00000000e+00, 1.00000000e+00], [0.00000000e+00, 4.90999985e+01, 9.80000019e-01, ..., 0.00000000e+00, 0.00000000e+00, 1.00000000e+00], [0.00000000e+00, 4.93333626e+01, 9.79999900e-01, ..., 0.00000000e+00, 0.00000000e+00, 3.63636374e-01]], [[0.00000000e+00, 2.08164997e+01, 9.80000019e-01, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [0.00000000e+00, 2.11499996e+01, 9.47500110e-01, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [0.00000000e+00, 2.18666821e+01, 9.67999697e-01, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], ..., [0.00000000e+00, 3.77332840e+01, 9.80000019e-01, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [0.00000000e+00, 3.80499954e+01, 9.79999840e-01, ..., 1.42857149e-01, 0.00000000e+00, 7.14285746e-02], [0.00000000e+00, 3.83999977e+01, 9.79999959e-01, ..., 1.00000000e+00, 0.00000000e+00, 1.00000000e+00]]]), 'audio': array([[[ 1.43043854e+02, 3.50877196e-02, 7.89537653e-02, ..., -3.48208278e-01, -3.06300998e-01, -2.95743704e-01], [ 1.19375000e+02, 8.24999988e-01, 7.57727250e-02, ..., -3.58252227e-01, -3.21442962e-01, -2.71030515e-01], [ 1.22771431e+02, 7.71428585e-01, 8.27167779e-02, ..., -3.75033975e-01, -3.09788316e-01, -2.03635067e-01], ..., [ 1.12680000e+02, 8.39999974e-01, 1.07694022e-01, ..., -3.66484642e-01, -3.60816032e-01, -3.39215398e-01], [ 1.15715515e+02, 4.65517253e-01, 1.02550417e-01, ..., -3.82131994e-01, -3.72763604e-01, -2.99578339e-01], [ 1.09870132e+02, 0.00000000e+00, 5.29019907e-02, ..., -4.04939830e-01, -3.62863749e-01, -3.29211295e-01]], [[ 0.00000000e+00, 0.00000000e+00, 0.00000000e+00, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [ 0.00000000e+00, 0.00000000e+00, 0.00000000e+00, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [ 0.00000000e+00, 0.00000000e+00, 0.00000000e+00, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], ..., [ 1.08277779e+02, 1.00000000e+00, 7.75072277e-02, ..., -3.68975878e-01, -3.45598340e-01, -3.60698819e-01], [ 1.14722221e+02, 8.33333313e-01, 1.05292089e-01, ..., -4.12092656e-01, -3.67974699e-01, -3.38693678e-01], [ 1.16790321e+02, 4.83870953e-02, 4.29005809e-02, ..., -3.64892572e-01, -3.36282581e-01, -3.01348567e-01]], [[ 0.00000000e+00, 0.00000000e+00, 0.00000000e+00, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [ 0.00000000e+00, 0.00000000e+00, 0.00000000e+00, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [ 0.00000000e+00, 0.00000000e+00, 0.00000000e+00, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], ..., [ 1.07361542e+02, 8.30769241e-01, 1.16486266e-01, ..., -2.92553514e-01, -3.48407954e-01, -2.89948344e-01], [ 1.07382355e+02, 1.76470593e-01, 4.44625355e-02, ..., -4.10069317e-01, -3.73818487e-01, -3.51448894e-01], [ 1.16328766e+02, 6.43835604e-01, 5.73611073e-02, ..., -3.55630755e-01, -3.35409462e-01, -2.81831741e-01]], ..., [[ 0.00000000e+00, 0.00000000e+00, 0.00000000e+00, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [ 0.00000000e+00, 0.00000000e+00, 0.00000000e+00, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [ 0.00000000e+00, 0.00000000e+00, 0.00000000e+00, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], ..., [ 1.59274994e+02, 6.00000024e-01, 1.11805059e-01, ..., -3.00966799e-01, -2.62476504e-01, -1.86356768e-01], [ 1.62933334e+02, 9.33333337e-01, 1.21559620e-01, ..., -2.65941620e-01, -1.58616230e-01, -2.74030026e-02], [ 1.41543472e+02, 1.00000000e+00, 1.35901362e-01, ..., -4.60150212e-01, -3.59288096e-01, -8.94598663e-02]], [[ 0.00000000e+00, 0.00000000e+00, 0.00000000e+00, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [ 0.00000000e+00, 0.00000000e+00, 0.00000000e+00, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], [ 0.00000000e+00, 0.00000000e+00, 0.00000000e+00, ..., 0.00000000e+00, 0.00000000e+00, 0.00000000e+00], ..., [ 1.33166672e+02, 0.00000000e+00, 4.88173626e-02, ..., -3.89387459e-01, -3.10032964e-01, -2.61343211e-01], [ 1.39562500e+02, 6.25000000e-01, 9.05716941e-02, ..., -2.71804124e-01, -2.88592011e-01, -2.25905135e-01], [ 1.43121216e+02, 9.39393938e-01, 1.83846503e-01, ..., -3.16309690e-01, -3.22368294e-01, -1.91329390e-01]], [[ 1.09599998e+02, 4.00000006e-01, 9.54534113e-02, ..., -2.91404396e-01, -2.98188895e-01, -3.83750230e-01], [ 1.14166664e+02, 8.88888896e-01, 1.20308243e-01, ..., -2.54072696e-01, -2.53010184e-01, -1.79377615e-01], [ 1.43591461e+02, 2.92682916e-01, 7.58097619e-02, ..., -3.66141677e-01, -3.37813854e-01, -3.06466073e-01], ..., [ 9.03181839e+01, 5.00000000e-01, 1.43155158e-01, ..., -4.11910027e-01, -3.09689879e-01, -2.81039357e-01], [ 1.18928574e+02, 7.38095224e-01, 1.02695577e-01, ..., -2.66661346e-01, -2.60553300e-01, -2.34472752e-01], [ 1.44983337e+02, 3.33333351e-02, 7.21620843e-02, ..., -4.13997233e-01, -3.32429498e-01, -2.81417012e-01]]]), 'text': array([[[ 0. , 0. , 0. , ..., 0. , 0. , 0. ], [ 0. , 0. , 0. , ..., 0. , 0. , 0. ], [ 0. , 0. , 0. , ..., 0. , 0. , 0. ], ..., [ 0.31924 , 0.06316 , -0.27858001, ..., 0.082745 , 0.097801 , 0.25044999], [-0.028387 , 0.050244 , -0.076597 , ..., -0.16328 , -0.043587 , 0.036996 ], [-0.70567 , 0.48464 , -0.26168999, ..., -0.1398 , 0.42835999, 0.017546 ]], [[ 0. , 0. , 0. , ..., 0. , 0. , 0. ], [ 0. , 0. , 0. , ..., 0. , 0. , 0. ], [ 0. , 0. , 0. , ..., 0. , 0. , 0. ], ..., [ 0.31924 , 0.06316 , -0.27858001, ..., 0.082745 , 0.097801 , 0.25044999], [ 0.27204001, -0.06203 , -0.1884 , ..., 0.13015001, -0.18317001, 0.1323 ], [-0.14968 , -0.42179 , -0.14162999, ..., -0.19318999, -0.010745 , -0.17146 ]], [[ 0. , 0. , 0. , ..., 0. , 0. , 0. ], [ 0. , 0. , 0. , ..., 0. , 0. , 0. ], [ 0. , 0. , 0. , ..., 0. , 0. , 0. ], ..., [ 0.03567 , 0.1856 , -0.30552 , ..., -0.22141001, 0.38281 , -0.033743 ], [ 0.033484 , -0.13765 , -0.31839001, ..., -0.22256 , 0.19444001, 0.084369 ], [ 0. , 0. , 0. , ..., 0. , 0. , 0. ]], ..., [[ 0. , 0. , 0. , ..., 0. , 0. , 0. ], [ 0. , 0. , 0. , ..., 0. , 0. , 0. ], [ 0. , 0. , 0. , ..., 0. , 0. , 0. ], ..., [ 0.18732999, 0.40595001, -0.51174003, ..., 0.16495 , 0.18757001, 0.53873998], [-0.014531 , -0.071761 , -0.59626001, ..., -0.12443 , 0.63753998, 0.12262 ], [ 0.0099776 , -0.20995 , -0.22245 , ..., -0.28757 , 0.22935 , 0.22752 ]], [[ 0. , 0. , 0. , ..., 0. , 0. , 0. ], [ 0. , 0. , 0. , ..., 0. , 0. , 0. ], [ 0. , 0. , 0. , ..., 0. , 0. , 0. ], ..., [ 0.09852 , 0.25001001, -0.27017999, ..., -0.062639 , 0.24424 , 0.17779 ], [ 0.18732999, 0.40595001, -0.51174003, ..., 0.16495 , 0.18757001, 0.53873998], [ 0.068879 , 0.2597 , -0.2746 , ..., -0.36559999, 0.20513999, -0.069834 ]], [[ 0.12802 , 0.21836001, -0.42346001, ..., -0.33825999, 0.45666 , 0.29839 ], [ 0.14714 , 0.14199001, -0.084105 , ..., -0.24668001, 0.49812001, 0.61899 ], [-0.18567 , 0.066008 , -0.25209001, ..., -0.023452 , 0.12302 , 0.3312 ], ..., [ 0.060216 , 0.21799 , -0.04249 , ..., 0.11709 , -0.16692001, -0.094085 ], [ 0.08649 , 0.14503001, -0.49020001, ..., 0.25909001, -0.18599001, 0.0085633 ], [ 0.19847 , 0.18087 , -0.089119 , ..., -0.24263 , -0.035183 , -0.29661 ]]]), 'labels': array([[[1. , 0.6666667 , 0.6666667 , ..., 0. , 0. , 0.6666667 ]], [[0.6666667 , 0. , 0. , ..., 0. , 0. , 0. ]], [[0. , 0.6666667 , 0.6666667 , ..., 0. , 0. , 0.33333334]], ..., [[0.33333334, 0. , 0. , ..., 0. , 0. , 0. ]], [[0. , 0. , 0. , ..., 0. , 0. , 0. ]], [[1. , 1. , 0. , ..., 0. , 0. , 0. ]]], dtype=float32), 'id': ['-3g5yACwYnA[0]', '-3g5yACwYnA[1]', '-3g5yACwYnA[2]', '-3g5yACwYnA[3]', '-3g5yACwYnA[4]', '-3g5yACwYnA[5]', '-3nNcZdcdvU[0]', '-3nNcZdcdvU[1]', '-3nNcZdcdvU[2]', '-HwX2H8Z4hY[0]', '-HwX2H8Z4hY[1]', '-HwX2H8Z4hY[2]', '-HwX2H8Z4hY[3]', '-HwX2H8Z4hY[4]', '-HwX2H8Z4hY[5]', '-HwX2H8Z4hY[6]', '-HwX2H8Z4hY[7]', '-HwX2H8Z4hY[8]', '-HwX2H8Z4hY[9]', '-THoVjtIkeU[0]', '-THoVjtIkeU[1]', '-THoVjtIkeU[2]', '-THoVjtIkeU[3]', '-THoVjtIkeU[4]', '-THoVjtIkeU[5]', '-THoVjtIkeU[6]', '-THoVjtIkeU[7]', '-UuX1xuaiiE[0]', '-UuX1xuaiiE[1]', '-UuX1xuaiiE[2]', '-UuX1xuaiiE[3]', '-UuX1xuaiiE[4]', '-UuX1xuaiiE[5]', '-UuX1xuaiiE[6]', '-UuX1xuaiiE[7]', '-UuX1xuaiiE[8]', '-UuX1xuaiiE[9]', '-WXXTNIJcVM[0]', '-WXXTNIJcVM[1]', '-WXXTNIJcVM[2]', '-WXXTNIJcVM[3]', '-WXXTNIJcVM[4]', '-ZgjBOA1Yhw[0]', '-ZgjBOA1Yhw[1]', '-ZgjBOA1Yhw[2]', '-ZgjBOA1Yhw[3]', '-ZgjBOA1Yhw[4]', '-ZgjBOA1Yhw[5]', '-a55Q6RWvTA[0]', '-aNfi7CP8vM[0]', '-aNfi7CP8vM[1]', '-aqamKhZ1Ec[0]', '-aqamKhZ1Ec[1]', '-aqamKhZ1Ec[2]', '-dxfTGcXJoc[0]', '-dxfTGcXJoc[1]', '-dxfTGcXJoc[2]', '-dxfTGcXJoc[3]', '-dxfTGcXJoc[4]', '-dxfTGcXJoc[5]', '-dxfTGcXJoc[6]', '-dxfTGcXJoc[7]', '-egA8-b7-3M[0]', '-egA8-b7-3M[10]', '-egA8-b7-3M[11]', '-egA8-b7-3M[12]', '-egA8-b7-3M[13]', '-egA8-b7-3M[14]', '-egA8-b7-3M[15]', '-egA8-b7-3M[16]', '-egA8-b7-3M[1]', '-egA8-b7-3M[2]', '-egA8-b7-3M[3]', '-egA8-b7-3M[4]', '-egA8-b7-3M[5]', '-egA8-b7-3M[6]', '-egA8-b7-3M[7]', '-egA8-b7-3M[8]', '-egA8-b7-3M[9]', '-iRBcNs9oI8[0]', '-iRBcNs9oI8[1]', '-iRBcNs9oI8[2]', '-iRBcNs9oI8[3]', '-iRBcNs9oI8[4]', '-iRBcNs9oI8[5]', '-iRBcNs9oI8[6]', '-iRBcNs9oI8[7]', '-iRBcNs9oI8[8]', '-iRBcNs9oI8[9]', '-lqc32Zpr7M[0]', '-lqc32Zpr7M[1]', '-lqc32Zpr7M[2]', '-lqc32Zpr7M[3]', '-lzEya4AM_4[0]', '-lzEya4AM_4[1]', '-lzEya4AM_4[2]', '-lzEya4AM_4[3]', '-lzEya4AM_4[4]', '-mJ2ud6oKI8[0]', '-mJ2ud6oKI8[1]', '-mJ2ud6oKI8[2]', '-mJ2ud6oKI8[3]', '-mJ2ud6oKI8[4]', '-mJ2ud6oKI8[5]', '-mJ2ud6oKI8[6]', '-mJ2ud6oKI8[7]', '-mJ2ud6oKI8[8]', '-mqbVkbCndg[0]', '-mqbVkbCndg[1]', '-mqbVkbCndg[2]', '-t217m2on-s[0]', '-t217m2on-s[1]', '-tANM6ETl_M[0]', '-tANM6ETl_M[1]', '-tANM6ETl_M[2]', '-tPCytz4rww[0]', '-tPCytz4rww[1]', '-tPCytz4rww[2]', '-tPCytz4rww[3]', '-tPCytz4rww[4]', '-tPCytz4rww[5]', '-vxjVxOeScU[0]', '-vxjVxOeScU[1]', '-vxjVxOeScU[2]', '-wMB_hJL-3o[0]', '-wMB_hJL-3o[1]', '-wMB_hJL-3o[2]', '-wMB_hJL-3o[3]', '-wny0OAz3g8[0]', '-wny0OAz3g8[1]', '-wny0OAz3g8[2]', '-wny0OAz3g8[3]', '-wny0OAz3g8[4]', '-wny0OAz3g8[5]', '-wny0OAz3g8[6]', '-wny0OAz3g8[7]', '-wny0OAz3g8[8]', '03X1FwF6udc[0]', '03X1FwF6udc[1]', '03X1FwF6udc[2]', '03X1FwF6udc[3]', '03X1FwF6udc[4]', '03X1FwF6udc[5]', '03X1FwF6udc[6]', '07Z16yRBFUQ[0]', '07Z16yRBFUQ[1]', '07Z16yRBFUQ[2]', '08d4NTXkSxw[0]', '08d4NTXkSxw[1]', '08d4NTXkSxw[2]', '08d4NTXkSxw[3]', '0AA-wmk8WdA[0]', '0AA-wmk8WdA[1]', '0AkGtPzl7D8[0]', '0BVed2nBq1g[0]', '0BVed2nBq1g[1]', '0BVed2nBq1g[2]', '0BVed2nBq1g[3]', '0BVed2nBq1g[4]', '0BVed2nBq1g[5]', '0BVed2nBq1g[6]', '0DBfvvIVmqY[0]', '0DBfvvIVmqY[10]', '0DBfvvIVmqY[1]', '0DBfvvIVmqY[2]', '0DBfvvIVmqY[3]', '0DBfvvIVmqY[4]', '0DBfvvIVmqY[5]', '0DBfvvIVmqY[6]', '0DBfvvIVmqY[7]', '0DBfvvIVmqY[8]', '0DBfvvIVmqY[9]', '0EAAfLCQabY[0]', '0EAAfLCQabY[1]', '0EAAfLCQabY[2]', '0EphpADwdPg[0]', '0EphpADwdPg[1]', '0EphpADwdPg[2]', '0EphpADwdPg[3]', '0EphpADwdPg[4]', '0EphpADwdPg[5]', '0FA32bEZ6xI[0]', '0FA32bEZ6xI[10]', '0FA32bEZ6xI[11]', '0FA32bEZ6xI[12]', '0FA32bEZ6xI[13]', '0FA32bEZ6xI[14]', '0FA32bEZ6xI[15]', '0FA32bEZ6xI[16]', '0FA32bEZ6xI[17]', '0FA32bEZ6xI[18]', '0FA32bEZ6xI[19]', '0FA32bEZ6xI[1]', '0FA32bEZ6xI[20]', '0FA32bEZ6xI[21]', '0FA32bEZ6xI[22]', '0FA32bEZ6xI[23]', '0FA32bEZ6xI[24]', '0FA32bEZ6xI[25]', '0FA32bEZ6xI[26]', '0FA32bEZ6xI[27]', '0FA32bEZ6xI[28]', '0FA32bEZ6xI[2]', '0FA32bEZ6xI[3]', '0FA32bEZ6xI[4]', '0FA32bEZ6xI[5]', '0FA32bEZ6xI[6]', '0FA32bEZ6xI[7]', '0FA32bEZ6xI[8]', '0FA32bEZ6xI[9]', '0JuRmhhgMw8[0]', '0JuRmhhgMw8[1]', '0JuRmhhgMw8[2]', '0JuRmhhgMw8[3]', '0JuRmhhgMw8[4]', '0JuRmhhgMw8[5]', '0JuRmhhgMw8[6]', '0JuRmhhgMw8[7]', '0OC3wf9x3zQ[0]', '0OC3wf9x3zQ[10]', '0OC3wf9x3zQ[1]', '0OC3wf9x3zQ[2]', '0OC3wf9x3zQ[3]', '0OC3wf9x3zQ[4]', '0OC3wf9x3zQ[5]', '0OC3wf9x3zQ[6]', '0OC3wf9x3zQ[7]', '0OC3wf9x3zQ[8]', '0OC3wf9x3zQ[9]', '0OXeN3MhFeA[0]', '0OXeN3MhFeA[1]', '0OXeN3MhFeA[2]', '0OXeN3MhFeA[3]', '0OXeN3MhFeA[4]', '0OXeN3MhFeA[5]', '0OXeN3MhFeA[6]', '0SfejBuLgFo[0]', '0SfejBuLgFo[1]', '0SfejBuLgFo[2]', '0SfejBuLgFo[3]', '0SfejBuLgFo[4]', '0SfejBuLgFo[5]', '0SfejBuLgFo[6]', '0SfejBuLgFo[7]', '0Svu5BldR5A[0]', '0Svu5BldR5A[1]', '0W4WsjhDgUI[0]', '0WIwQgH4lKg[0]', '0WIwQgH4lKg[1]', '0WIwQgH4lKg[2]', '0WIwQgH4lKg[3]', '0WIwQgH4lKg[4]', '0WIwQgH4lKg[5]', '0Xs8wJrAmxs[0]', '0Xs8wJrAmxs[1]', '0Xs8wJrAmxs[2]', '0Xs8wJrAmxs[3]', '0YdYFtVdlWE[0]', '0YdYFtVdlWE[10]', '0YdYFtVdlWE[11]', '0YdYFtVdlWE[12]', '0YdYFtVdlWE[13]', '0YdYFtVdlWE[14]', '0YdYFtVdlWE[15]', '0YdYFtVdlWE[16]', '0YdYFtVdlWE[17]', '0YdYFtVdlWE[18]', '0YdYFtVdlWE[19]', '0YdYFtVdlWE[1]', '0YdYFtVdlWE[20]', '0YdYFtVdlWE[21]', '0YdYFtVdlWE[2]', '0YdYFtVdlWE[3]', '0YdYFtVdlWE[4]', '0YdYFtVdlWE[5]', '0YdYFtVdlWE[6]', '0YdYFtVdlWE[7]', '0YdYFtVdlWE[8]', '0YdYFtVdlWE[9]', '0bsTzavb-AE[0]', '0bsTzavb-AE[1]', '0bsTzavb-AE[2]', '0bsTzavb-AE[3]', '0cBmQ_ItVUc[0]', '0cBmQ_ItVUc[10]', '0cBmQ_ItVUc[1]', '0cBmQ_ItVUc[2]', '0cBmQ_ItVUc[3]', '0cBmQ_ItVUc[4]', '0cBmQ_ItVUc[5]', '0cBmQ_ItVUc[6]', '0cBmQ_ItVUc[7]', '0cBmQ_ItVUc[8]', '0cBmQ_ItVUc[9]', '0hCOCt6fWas[0]', '0hCOCt6fWas[1]', '0hCOCt6fWas[2]', '0hCOCt6fWas[3]', '0hCOCt6fWas[4]', '0hCOCt6fWas[5]', '0hCihQ5Kep0[0]', '0hCihQ5Kep0[1]', '0hCihQ5Kep0[2]', '0jtdrsmVzYQ[0]', '0jtdrsmVzYQ[1]', '0mXv97u2OCM[0]', '0mXv97u2OCM[1]', '0nJrksJ7azM[0]', '0nJrksJ7azM[1]', '0nJrksJ7azM[2]', '0nJrksJ7azM[3]', '0nJrksJ7azM[4]', '0nJrksJ7azM[5]', '0p9XKC_J3hU[0]', '0r8KVXUCV6c[0]', '0r8KVXUCV6c[1]', '0r8KVXUCV6c[2]', '0r8KVXUCV6c[3]', '0rE8jEvQW_I[0]', '0rE8jEvQW_I[1]', '0rE8jEvQW_I[2]', '0rE8jEvQW_I[3]', '0rE8jEvQW_I[4]', '0rE8jEvQW_I[5]', '0rE8jEvQW_I[6]', '0rE8jEvQW_I[7]', '0rE8jEvQW_I[8]', '0tkWa2skSmA[0]', '0tkWa2skSmA[1]', '0vXaXWx7Rvo[0]', '0vXaXWx7Rvo[1]', '0vXaXWx7Rvo[2]', '0vXaXWx7Rvo[3]', '0vXaXWx7Rvo[4]', '0vXaXWx7Rvo[5]', '0zl_GDVzykw[0]', '0zl_GDVzykw[1]', '100499[0]', '100499[1]', '100499[2]', '100499[3]', '100499[4]', '100499[5]', '100499[6]', '101851[0]', '101851[10]', '101851[11]', '101851[12]', '101851[13]', '101851[14]', '101851[15]', '101851[16]', '101851[17]', '101851[18]', '101851[19]', '101851[1]', '101851[20]', '101851[2]', '101851[3]', '101851[4]', '101851[5]', '101851[6]', '101851[7]', '101851[8]', '101851[9]', '102168[0]', '102168[1]', '102168[2]', '102168[3]', '102168[4]', '102184[0]', '102184[10]', '102184[11]', '102184[12]', '102184[13]', '102184[1]', '102184[2]', '102184[3]', '102184[4]', '102184[5]', '102184[6]', '102184[7]', '102184[8]', '102184[9]', '10223[0]', '10223[1]', '10223[2]', '10223[3]', '10223[4]', '10223[5]', '10223[6]', '10223[7]', '10223[8]', '10223[9]', '106077[0]', '106077[10]', '106077[11]', '106077[12]', '106077[13]', '106077[14]', '106077[1]', '106077[2]', '106077[3]', '106077[4]', '106077[5]', '106077[6]', '106077[7]', '106077[8]', '106077[9]', '106514[0]', '106514[10]', '106514[11]', '106514[12]', '106514[13]', '106514[14]', '106514[15]', '106514[16]', '106514[17]', '106514[1]', '106514[2]', '106514[3]', '106514[4]', '106514[5]', '106514[6]', '106514[7]', '106514[8]', '106514[9]', '106941[0]', '106941[10]', '106941[11]', '106941[12]', '106941[1]', '106941[2]', '106941[3]', '106941[4]', '106941[5]', '106941[6]', '106941[7]', '106941[8]', '106941[9]', '107551[0]', '107551[10]', '107551[11]', '107551[12]', '107551[13]', '107551[14]', '107551[1]', '107551[2]', '107551[3]', '107551[4]', '107551[5]', '107551[6]', '107551[7]', '107551[8]', '107551[9]', '108793[0]', '108793[10]', '108793[11]', '108793[12]', '108793[13]', '108793[14]', '108793[15]', '108793[16]', '108793[17]', '108793[18]', '108793[1]', '108793[2]', '108793[3]', '108793[4]', '108793[5]', '108793[6]', '108793[7]', '108793[8]', '108793[9]', '110203[0]', '110203[1]', '110203[2]', '110203[3]', '110203[4]', '110203[5]', '110203[6]', '110203[7]', '110203[8]', '110203[9]', '110754[0]', '110754[10]', '110754[11]', '110754[1]', '110754[2]', '110754[3]', '110754[4]', '110754[5]', '110754[6]', '110754[7]', '110754[8]', '110754[9]', '110766[0]', '110766[1]', '110766[2]', '110766[3]', '110766[4]', '110766[5]', '110766[6]', '110766[7]', '110766[8]', '110766[9]', '110788[0]', '110788[1]', '110788[2]', '110788[3]', '110788[4]', '110788[5]', '110788[6]', '112148[0]', '112148[10]', '112148[11]', '112148[12]', '112148[13]', '112148[1]', '112148[2]', '112148[3]', '112148[4]', '112148[5]', '112148[6]', '112148[7]', '112148[8]', '112148[9]', '112169[0]', '112169[10]', '112169[11]', '112169[12]', '112169[13]', '112169[1]', '112169[2]', '112169[3]', '112169[4]', '112169[5]', '112169[6]', '112169[7]', '112169[8]', '112169[9]', '112223[0]', '112223[10]', '112223[11]', '112223[1]', '112223[2]', '112223[3]', '112223[4]', '112223[5]', '112223[6]', '112223[7]', '112223[8]', '112223[9]', '112604[0]', '112604[1]', '112604[2]', '112604[3]', '112604[4]', '112631[0]', '112631[1]', '112631[2]', '112631[3]', '112631[4]', '112631[5]', '112631[6]', '112631[7]', '112631[8]', '112631[9]', '112903[0]', '112903[1]', '112903[2]', '112903[3]', '112903[4]', '112903[5]', '112903[6]', '113265[0]', '113265[1]', '113265[2]', '113265[3]', '113265[4]', '113265[5]', '113265[6]', '113265[7]', '113265[8]', '113265[9]', '114624[0]', '114624[10]', '114624[11]', '114624[12]', '114624[13]', '114624[1]', '114624[2]', '114624[3]', '114624[4]', '114624[5]', '114624[6]', '114624[7]', '114624[8]', '114624[9]', '11650[0]', '11650[10]', '11650[11]', '11650[12]', '11650[13]', '11650[14]', '11650[15]', '11650[16]', '11650[17]', '11650[18]', '11650[19]', '11650[1]', '11650[20]', '11650[21]', '11650[22]', '11650[23]', '11650[24]', '11650[2]', '11650[3]', '11650[4]', '11650[5]', '11650[6]', '11650[7]', '11650[8]', '11650[9]', '119348[0]', '119348[10]', '119348[11]', '119348[12]', '119348[1]', '119348[2]', '119348[3]', '119348[4]', '119348[5]', '119348[6]', '119348[7]', '119348[8]', '119348[9]', '120vnZnmhq4[0]', '121358[0]', '121358[10]', '121358[11]', '121358[12]', '121358[13]', '121358[14]', '121358[15]', '121358[16]', '121358[17]', '121358[18]', '121358[19]', '121358[1]', '121358[20]', '121358[21]', '121358[22]', '121358[2]', '121358[3]', '121358[4]', '121358[5]', '121358[6]', '121358[7]', '121358[8]', '121358[9]', '122439[0]', '122439[1]', '122439[2]', '122439[3]', '122439[4]', '122439[5]', '122439[6]', '122439[7]', '122439[8]', '122439[9]', '122602[0]', '122602[10]', '122602[11]', '122602[12]', '122602[13]', '122602[14]', '122602[15]', '122602[16]', '122602[17]', '122602[18]', '122602[1]', '122602[2]', '122602[3]', '122602[4]', '122602[5]', '122602[6]', '122602[7]', '122602[8]', '122602[9]', '122842[0]', '122842[10]', '122842[11]', '122842[12]', '122842[1]', '122842[2]', '122842[3]', '122842[4]', '122842[5]', '122842[6]', '122842[7]', '122842[8]', '122842[9]', '125708[0]', '125730[0]', '125730[10]', '125730[11]', '125730[12]', '125730[13]', '125730[14]', '125730[15]', '125730[1]', '125730[2]', '125730[3]', '125730[4]', '125730[5]', '125730[6]', '125730[7]', '125730[8]', '125730[9]', '125845[0]', '125845[10]', '125845[1]', '125845[2]', '125845[3]', '125845[4]', '125845[5]', '125845[6]', '125845[7]', '125845[8]', '125845[9]', '125895[0]', '125895[1]', '125895[2]', '125895[3]', '125895[4]', '125895[5]', '125895[6]', '125895[7]', '125895[8]', '125895[9]', '126542[0]', '126542[10]', '126542[11]', '126542[12]', '126542[13]', '126542[14]', '126542[15]', '126542[16]', '126542[17]', '126542[1]', '126542[2]', '126542[3]', '126542[4]', '126542[5]', '126542[6]', '126542[7]', '126542[8]', '126542[9]', '126831[0]', '126831[10]', '126831[11]', '126831[12]', '126831[13]', '126831[14]', '126831[15]', '126831[16]', '126831[17]', '126831[1]', '126831[2]', '126831[3]', '126831[4]', '126831[5]', '126831[6]', '126831[7]', '126831[8]', '126831[9]', '127470[0]', '127470[10]', '127470[11]', '127470[12]', '127470[1]', '127470[2]', '127470[3]', '127470[4]', '127470[5]', '127470[6]', '127470[7]', '127470[8]', '127470[9]', '127539[0]', '127539[1]', '127539[2]', '127539[3]', '127539[4]', '127539[5]', '127539[6]', '127539[7]', '127539[8]', '127539[9]', '12812[0]', '12812[1]', '12812[2]', '12812[3]', '12812[4]', '12812[5]', '12812[6]', '128258[0]', '128258[10]', '128258[11]', '128258[12]', '128258[13]', '128258[14]', '128258[1]', '128258[2]', '128258[3]', '128258[4]', '128258[5]', '128258[6]', '128258[7]', '128258[8]', '128258[9]', '128752[0]', '128752[10]', '128752[11]', '128752[12]', '128752[13]', '128752[14]', '128752[15]', '128752[16]', '128752[1]', '128752[2]', '128752[3]', '128752[4]', '128752[5]', '128752[6]', '128752[7]', '128752[8]', '128752[9]', '128949[0]', '128949[1]', '128949[2]', '128949[3]', '128949[4]', '128949[5]', '128949[6]', '128949[7]', '128949[8]', '129733[0]', '129733[10]', '129733[11]', '129733[1]', '129733[2]', '129733[3]', '129733[4]', '129733[5]', '129733[6]', '129733[7]', '129733[8]', '129733[9]', '130149[0]', '130149[1]', '130149[2]', '130149[3]', '130149[4]', '130149[5]', '130149[6]', '130426[0]', '130426[1]', '130426[2]', '130426[3]', '130426[4]', '130426[5]', '130426[6]', '130426[7]', '130426[8]', '130448[0]', '130448[1]', '130448[2]', '130448[3]', '130448[4]', '130448[5]', '130448[6]', '130448[7]', '130448[8]', '130448[9]', '130633[0]', '130633[10]', '130633[1]', '130633[2]', '130633[3]', '130633[4]', '130633[5]', '130633[6]', '130633[7]', '130633[8]', '130633[9]', '131650[0]', '131650[10]', '131650[1]', '131650[2]', '131650[3]', '131650[4]', '131650[5]', '131650[6]', '131650[7]', '131650[8]', '131650[9]', '131871[0]', '131871[1]', '131871[2]', '131871[3]', '131871[4]', '131871[5]', '131871[6]', '131871[7]', '131871[8]', '131936[0]', '131936[1]', '131936[2]', '131936[3]', '131936[4]', '131936[5]', '131936[6]', '131936[7]', '134252[0]', '134252[1]', '134252[2]', '134252[3]', '134252[4]', '134252[5]', '134252[6]', '134252[7]', '134252[8]', '134252[9]', '136205[0]', '136205[10]', '136205[11]', '136205[12]', '136205[13]', '136205[14]', '136205[15]', '136205[1]', '136205[2]', '136205[3]', '136205[4]', '136205[5]', '136205[6]', '136205[7]', '136205[8]', '136205[9]', '136211[0]', '136211[1]', '136211[2]', '136211[3]', '136211[4]', '136211[5]', '136211[6]', '136211[7]', '136215[0]', '136215[10]', '136215[11]', '136215[12]', '136215[13]', '136215[14]', '136215[1]', '136215[2]', '136215[3]', '136215[4]', '136215[5]', '136215[6]', '136215[7]', '136215[8]', '136215[9]', '137827[0]', '137827[1]', '137827[2]', '137827[3]', '137827[4]', '137827[5]', '137827[6]', '139006[0]', '139006[10]', '139006[11]', '139006[12]', '139006[1]', '139006[2]', '139006[3]', '139006[4]', '139006[5]', '139006[6]', '139006[7]', '139006[8]', '139006[9]', '139032[0]', '139032[10]', '139032[11]', '139032[12]', '139032[13]', '139032[14]', '139032[15]', '139032[16]', '139032[17]', '139032[1]', '139032[2]', '139032[3]', '139032[4]', '139032[5]', '139032[6]', '139032[7]', '139032[8]', '139032[9]', '13JpsLvddoY[0]', '13JpsLvddoY[1]', '13JpsLvddoY[2]', '13JpsLvddoY[3]', '140293[0]', '140293[1]', '140293[2]', '140293[3]', '140293[4]', '140293[5]', '140293[6]', '140293[7]', '140317[0]', '140317[10]',
°Sun
***@***.***
…------------------ 原始邮件 ------------------
发件人: "kimkyeonghun/MSA" ***@***.***>;
发送时间: 2023年4月17日(星期一) 中午1:17
***@***.***>;
***@***.******@***.***>;
主题: Re: [kimkyeonghun/MSA] How to solve this problem? (Issue #3)
Can you show me train_data structure?
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you authored the thread.Message ID: ***@***.***>
kimkyeonghun commented
I think data structure is different.
You must modify data structure following as:
Data Strcuture
data ----train = (word,visual,speech),label(sentimnet),segment(situation number)
|
----val = (word,visual,speech),label(sentimnet),segment(situation number)
|
----test = (word,visual,speech),label(sentimnet),segment(situation number)
sunqing-code commented
Ok,Would you like to share the data with me?
°Sun
***@***.***
…------------------ 原始邮件 ------------------
发件人: "kimkyeonghun/MSA" ***@***.***>;
发送时间: 2023年4月18日(星期二) 上午9:41
***@***.***>;
***@***.******@***.***>;
主题: Re: [kimkyeonghun/MSA] How to solve this problem? (Issue #3)
I think data structure is different.
You must modify data structure following as:
Data Strcuture
data ----train = (word,visual,speech),label(sentimnet),segment(situation number)
|
----val = (word,visual,speech),label(sentimnet),segment(situation number)
|
----test = (word,visual,speech),label(sentimnet),segment(situation number)
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you authored the thread.Message ID: ***@***.***>
kimkyeonghun commented
You can get data from 'https://github.com/A2Zadeh/CMU-MultimodalSDK'
sunqing-code commented
Excuse me, When I was running the train.py using the cmu_mosi dataset, I was prompted to need the 'cmu_mosi.pkl' ,but I didn't get this file from 'https://github.com/A2Zadeh/CMU-MultimodalSDK'. How can I get 'cmu_mosi.pkl'?
°Sun
***@***.***
…------------------ 原始邮件 ------------------
发件人: "kimkyeonghun/MSA" ***@***.***>;
发送时间: 2023年4月18日(星期二) 上午9:50
***@***.***>;
***@***.******@***.***>;
主题: Re: [kimkyeonghun/MSA] How to solve this problem? (Issue #3)
You can get data from 'https://github.com/A2Zadeh/CMU-MultimodalSDK'
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you authored the thread.Message ID: ***@***.***>
1586359975 commented
run pre_processing,py