What is the meanings of `shape_type`, `color_mult` and `third_frame_motion` in meta files?
edydfang opened this issue · 2 comments
{
"background_file":"/home/tiam/project_data/tf_deep_mag/raw_ingredients/coco_train2017/000000225345.jpg",
"third_frame_motion":1.0,
"sample_properties":[
{
"color_add":[
1.925357951045477,
9.502529585992523,
7.880988956721406
],
"fg_idx":1311,
"orientation":3.301299684358326,
"motion_dir":5.8994013477181255,
"shape_type":2,
"color_mult":[
1.0,
1.0,
1.0
],
"aspect_ratio":2.191457788030521,
"scaling":0.195800786759281,
"motion_amount":0.3861106423132381,
"center":[
190.46849859664286,
208.1545052627958
]
},
{
"color_add":[
-10.01393090981086,
-7.44447289150088,
-3.836791152177721
],
"fg_idx":4712,
"orientation":1.2146459169689545,
"motion_dir":2.8215923059585046,
"shape_type":2,
"color_mult":[
1.0,
1.0,
1.0
],
"aspect_ratio":1.575751231357717,
"scaling":0.7695978265063551,
"motion_amount":0.9252538154237787,
"center":[
138.44686122207858,
274.563682226355
]
},
{
"color_add":[
13.653071468187918,
14.028489528534774,
-8.215312919870719
],
"fg_idx":5718,
"orientation":2.054352406981038,
"motion_dir":0.10612433944136192,
"shape_type":3,
"color_mult":[
1.0,
1.0,
1.0
],
"aspect_ratio":1.759935147917405,
"scaling":0.799292509942318,
"motion_amount":1.008468522062427,
"center":[
299.6627111293551,
244.2818327143585
]
},
{
"color_add":[
11.15283742278356,
-2.560571143035471,
13.147733175999939
],
"fg_idx":3507,
"orientation":0.4777896338358551,
"motion_dir":3.184019233633535,
"shape_type":1,
"color_mult":[
1.0,
1.0,
1.0
],
"aspect_ratio":2.7324625189657796,
"scaling":0.10427110663734562,
"motion_amount":0.4029012709278865,
"center":[
374.5391294523404,
85.92793533987069
]
},
{
"color_add":[
-7.741979262278923,
10.189081151868574,
14.194209720121702
],
"fg_idx":1416,
"orientation":4.676984784008412,
"motion_dir":4.486443504656097,
"shape_type":2,
"color_mult":[
1.0,
1.0,
1.0
],
"aspect_ratio":0.11384226239960371,
"scaling":0.5548262804937897,
"motion_amount":0.0843749640576295,
"center":[
215.72180825160055,
9.213579577060514
]
},
{
"color_add":[
-2.3170936238533315,
-8.917824166917462,
3.6573973430047566
],
"fg_idx":4341,
"orientation":5.684192681269192,
"motion_dir":1.8791328006121593,
"shape_type":3,
"color_mult":[
1.0,
1.0,
1.0
],
"aspect_ratio":2.6267749876376825,
"scaling":0.6529448261831385,
"motion_amount":0.43769959396502617,
"center":[
41.803534791626944,
61.853745682737994
]
},
{
"color_add":[
-7.576833772172929,
8.619156100953902,
6.769010895167728
],
"fg_idx":1717,
"orientation":6.17109738993578,
"motion_dir":0.6974625676398899,
"shape_type":1,
"color_mult":[
1.0,
1.0,
1.0
],
"aspect_ratio":0.37686866068980446,
"scaling":0.6900220937610626,
"motion_amount":0.20012596632715263,
"center":[
125.69403191253784,
93.55391836687608
]
},
{
"color_add":[
-8.870124580096775,
-14.199621328432295,
-2.6015452878369505
],
"fg_idx":663,
"orientation":3.8206371992641466,
"motion_dir":3.524134968760174,
"shape_type":1,
"color_mult":[
1.0,
1.0,
1.0
],
"aspect_ratio":1.3452644797115627,
"scaling":0.45703039713457094,
"motion_amount":0.5315456823000649,
"center":[
337.18518966576335,
293.3950208811551
]
},
{
"color_add":[
-12.987699689796031,
5.82086276136825,
-5.900104564786595
],
"fg_idx":3452,
"orientation":0.5694792141183294,
"motion_dir":5.072288980793892,
"shape_type":2,
"color_mult":[
1.0,
1.0,
1.0
],
"aspect_ratio":0.8311780579834941,
"scaling":0.34532467780479253,
"motion_amount":0.9680977920488166,
"center":[
167.71642386436253,
142.27622959742757
]
}
],
"color_amplification_factor":1.0,
"amplification_factor":28.351030206327763,
"bg_properties":{
"motion_dir":5.543601538543549,
"color_mult":[
1.0,
1.0,
1.0
],
"color_add":[
-10.990955175457486,
-14.4096269084179,
-13.60394413364702
],
"motion_amount":0.030528508874763105,
"bg_blur_amount":4.732548688741219
}
}I downloaded the whole dataset to figure out how you prepare the data for training. And I understand most of the parameters in the meta files. However, I am not clear about shape_type, color_mult and third_frame_motion in the meta files. Thank you for your help!
You should ignore shape_type which is a left over from development when we experiment with different foreground objects.
color_mult has to do with color perturbation of the third/second frame.
third_frame_motion is the motion of the third frame. If I remember correctly, this is expressed as multiplier of the motion amplitude (motion_amount).
Hope this helps!
You should ignore
shape_typewhich is a left over from development when we experiment with different foreground objects.
color_multhas to do with color perturbation of the third/second frame.
third_frame_motionis the motion of the third frame. If I remember correctly, this is expressed as multiplier of the motion amplitude (motion_amount).Hope this helps!
Thanks a lot!