vgg16_hybrid_places_1365a.py predicts only ImageNet classes
atunick opened this issue · 1 comments
The hybrid CNN vgg16_hybrid_places_1365.py appears to predict only ImageNet classes rather than including neural net predictions for the 365 Places categories.
As an example, with the newly converted training weights provided by Pavel Gonchar, analysis of the image http://places2.csail.mit.edu/imgs/demo/6.jpg results in the following:
top-5 probabilities [ 0.17788495 0.1438169 0.09974416 0.03602608 0.02783776]
top_5 predictions [865 917 611 819 509]
--SCENE CATEGORIES:
toyshop
comic book
jigsaw puzzle
stage
confectionery, confectionary, candy store.
Clearly these are not the Places classes suggested by G Kalliatakis in his code vgg16_hybrid_places_1365.py, i.e,,
--PREDICTED SCENE CATEGORIES:
# restaurant, eating
# house, eating
# place, eatery
# folding
# chair
# patio, terrace
# food_court
# cafeteria
As another example, the vgg16_hybrid_places_1365 CNN results for the attached "beach" image are:
top_5 probabilities [ 0.28962466 0.14460842 0.10124382 0.08060224 0.0580104 ]
top_5 predictions 1 (5L,) [842 445 978 977 638]
--SCENE CATEGORIES:
swimming trunks, bathing trunks
bikini, two-piece
seashore, coast, seacoast, sea-coast
sandbar, sand bar
maillot
Again, where are the Places class label predictions?
PLEASE ADVISE.
THANK YOU.
@atunick I have rerun the example with the image http://places2.csail.mit.edu/imgs/demo/6.jpg and the results are the following for the (hybrid model):
--PREDICTED SCENE CATEGORIES:
restaurant, eating house, eating place, eatery
folding chair
patio, terrace
food_court
cafeteria
Regarding the other image https://user-images.githubusercontent.com/17481462/40858563-adb86a74-65ac-11e8-91ae-2363f9687c3f.jpg using the hybrid model I get the following predictions:
--PREDICTED SCENE CATEGORIES:
seashore, coast, seacoast, sea-coast
sandbar, sand bar
swimming trunks, bathing trunks
maillot, tank suit
bikini, two-piece
while using the plain VGG16-places365 model results in the following predictions:
--PREDICTED SCENE CATEGORIES:
desert/sand
desert_road
beach
coast
desert/vegetation
So, clearly both models are working fine. As expected for the same image the hybrid version and the original version will come up with different predictions and clearly the provided image contains not only the beach as a place but a person wearing a swimming trunk etc.
Your problem for getting different results might lie in the fact that your
cache_subdir = 'models'
might contain the weights from the previous version. So try deleting all previous weight files and running the scripts again before reporting your new results.