Mondego/oreo

No Clone is Detected

Feri73 opened this issue · 1 comments

Feri73 commented

Hi,
When I run controller.py, nothing is generated in the candidates folder (I have repeated the same program 10 times so there are clones!), and the log file says that number of clone pairs is 0. Also the files candidates.file and query,file are empty for all shards.
What can cause this?
Here is the content of the log file in SCC_LOGS/NODE_1/scc.log:
2019-04-14 21:49:36,401 INFO c.m.i.SearchManager [main] user.dir is: /mnt/c/Users/Feri73/Desktop/oreo-FSE_Artifact/clone-detector
2019-04-14 21:49:36,402 INFO c.m.i.SearchManager [main] root dir is:/mnt/c/Users/Feri73/Desktop/oreo-FSE_Artifact/clone-detector/
2019-04-14 21:49:36,402 INFO c.m.i.SearchManager [main] reading Q values from properties file
2019-04-14 21:49:36,403 INFO c.m.i.SearchManager [main] propertiesPath: /mnt/c/Users/Feri73/Desktop/oreo-FSE_Artifact/clone-detector/NODE_1/sourcerer-cc.properties
2019-04-14 21:49:36,416 INFO c.m.i.SearchManager [main] Query path:/mnt/c/Users/Feri73/Desktop/oreo-FSE_Artifact/clone-detector/input/dataset
2019-04-14 21:49:36,416 INFO c.m.i.SearchManager [main] level1ShardSegmentString String is : 30,60,120,300,600
2019-04-14 21:49:36,418 INFO c.m.m.Shard [main] shard Shard [id=1, minSizeToSearch=1, maxSizeToSearch=30, minBagSizeToIndex=1, maxBagSizeToIndex=50, indexPath=1, subshardsSize=0] created
2019-04-14 21:49:36,418 INFO c.m.m.Shard [main] shard Shard [id=2, minSizeToSearch=31, maxSizeToSearch=60, minBagSizeToIndex=19, maxBagSizeToIndex=100, indexPath=2, subshardsSize=0] created
2019-04-14 21:49:36,418 INFO c.m.m.Shard [main] shard Shard [id=3, minSizeToSearch=61, maxSizeToSearch=120, minBagSizeToIndex=37, maxBagSizeToIndex=200, indexPath=3, subshardsSize=0] created
2019-04-14 21:49:36,418 INFO c.m.m.Shard [main] shard Shard [id=4, minSizeToSearch=121, maxSizeToSearch=300, minBagSizeToIndex=73, maxBagSizeToIndex=500, indexPath=4, subshardsSize=0] created
2019-04-14 21:49:36,418 INFO c.m.m.Shard [main] shard Shard [id=5, minSizeToSearch=301, maxSizeToSearch=600, minBagSizeToIndex=181, maxBagSizeToIndex=1000, indexPath=5, subshardsSize=0] created
2019-04-14 21:49:36,418 INFO c.m.m.Shard [main] shard Shard [id=6, minSizeToSearch=601, maxSizeToSearch=500000, minBagSizeToIndex=361, maxBagSizeToIndex=833333, indexPath=6, subshardsSize=0] created
2019-04-14 21:49:36,418 INFO c.m.i.SearchManager [main] Number of Top level shards created: 6
2019-04-14 21:49:36,418 INFO c.m.i.SearchManager [main] action: search
threshold: 6
QLQ_THREADS: 1 QBQ_THREADS: 4 QCQ_THREADS: 10 VCQ_THREADS: 1 RCQ_THREADS: 1

2019-04-14 21:49:36,418 INFO c.m.i.SearchManager [main] initializing channels
2019-04-14 21:49:36,420 INFO c.m.i.SearchManager [main] action: search
threshold: 6
BQ_THREADS: 1
SBQ_THREADS: 1
IIQ_THREADS: 1

2019-04-14 21:49:36,421 INFO c.m.i.SearchManager [main] METRICS_ORDER_IN_SHARDS created: 1
2019-04-14 21:49:36,421 DEBUG c.m.i.SearchManager [main] NODE_1 MAX_TOKENS=500000 MIN_TOKENS=1
2019-04-14 21:49:36,423 INFO c.m.u.Util [main] creating directory: /mnt/c/Users/Feri73/Desktop/oreo-FSE_Artifact/clone-detector/NODE_1/output6.0
2019-04-14 21:49:36,424 INFO c.m.i.SearchManager [main] Query File: /mnt/c/Users/Feri73/Desktop/oreo-FSE_Artifact/clone-detector/index/1/query.file
2019-04-14 21:49:36,431 INFO c.m.i.SearchManager [main] creating indexes for /mnt/c/Users/Feri73/Desktop/oreo-FSE_Artifact/clone-detector/index/1/candidates.file
2019-04-14 21:49:36,432 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 68 micro seconds
2019-04-14 21:49:36,432 INFO c.m.i.SearchManager [main] indexes created
2019-04-14 21:49:36,433 INFO c.m.i.SearchManager [main] initializing channels
2019-04-14 21:49:36,433 INFO c.m.i.SearchManager [main] shutting down channels
2019-04-14 21:49:36,433 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 14 micro seconds
2019-04-14 21:49:36,433 INFO c.m.i.SearchManager [main] shutting down QLQ, 1555278576433
2019-04-14 21:49:36,433 INFO c.m.i.SearchManager [main] shutting down QBQ, 1555278576433
2019-04-14 21:49:36,433 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 10 micro seconds
2019-04-14 21:49:36,433 INFO c.m.i.SearchManager [main] shutting down QCQ, 1555278576433
2019-04-14 21:49:36,433 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 11 micro seconds
2019-04-14 21:49:36,433 INFO c.m.i.SearchManager [main] shutting down VCQ, 1555278576433
2019-04-14 21:49:36,433 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 9 micro seconds
2019-04-14 21:49:36,434 INFO c.m.i.SearchManager [main] shutting down RCQ, 1555278576434
2019-04-14 21:49:36,434 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 10 micro seconds
2019-04-14 21:49:36,434 INFO c.m.i.SearchManager [main] COMPLETED LINES: -1
2019-04-14 21:49:36,434 INFO c.m.i.SearchManager [main] Query File: /mnt/c/Users/Feri73/Desktop/oreo-FSE_Artifact/clone-detector/index/2/query.file
2019-04-14 21:49:36,439 INFO c.m.i.SearchManager [main] creating indexes for /mnt/c/Users/Feri73/Desktop/oreo-FSE_Artifact/clone-detector/index/2/candidates.file
2019-04-14 21:49:36,439 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 20 micro seconds
2019-04-14 21:49:36,439 INFO c.m.i.SearchManager [main] indexes created
2019-04-14 21:49:36,439 INFO c.m.i.SearchManager [main] initializing channels
2019-04-14 21:49:36,440 INFO c.m.i.SearchManager [main] shutting down channels
2019-04-14 21:49:36,440 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 12 micro seconds
2019-04-14 21:49:36,440 INFO c.m.i.SearchManager [main] shutting down QLQ, 1555278576440
2019-04-14 21:49:36,440 INFO c.m.i.SearchManager [main] shutting down QBQ, 1555278576440
2019-04-14 21:49:36,440 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 11 micro seconds
2019-04-14 21:49:36,440 INFO c.m.i.SearchManager [main] shutting down QCQ, 1555278576440
2019-04-14 21:49:36,440 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 12 micro seconds
2019-04-14 21:49:36,440 INFO c.m.i.SearchManager [main] shutting down VCQ, 1555278576440
2019-04-14 21:49:36,440 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 10 micro seconds
2019-04-14 21:49:36,440 INFO c.m.i.SearchManager [main] shutting down RCQ, 1555278576440
2019-04-14 21:49:36,440 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 10 micro seconds
2019-04-14 21:49:36,440 INFO c.m.i.SearchManager [main] COMPLETED LINES: -1
2019-04-14 21:49:36,440 INFO c.m.i.SearchManager [main] Query File: /mnt/c/Users/Feri73/Desktop/oreo-FSE_Artifact/clone-detector/index/3/query.file
2019-04-14 21:49:36,446 INFO c.m.i.SearchManager [main] creating indexes for /mnt/c/Users/Feri73/Desktop/oreo-FSE_Artifact/clone-detector/index/3/candidates.file
2019-04-14 21:49:36,446 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 17 micro seconds
2019-04-14 21:49:36,446 INFO c.m.i.SearchManager [main] indexes created
2019-04-14 21:49:36,446 INFO c.m.i.SearchManager [main] initializing channels
2019-04-14 21:49:36,447 INFO c.m.i.SearchManager [main] shutting down channels
2019-04-14 21:49:36,447 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 20 micro seconds
2019-04-14 21:49:36,447 INFO c.m.i.SearchManager [main] shutting down QLQ, 1555278576447
2019-04-14 21:49:36,447 INFO c.m.i.SearchManager [main] shutting down QBQ, 1555278576447
2019-04-14 21:49:36,447 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 11 micro seconds
2019-04-14 21:49:36,447 INFO c.m.i.SearchManager [main] shutting down QCQ, 1555278576447
2019-04-14 21:49:36,447 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 11 micro seconds
2019-04-14 21:49:36,447 INFO c.m.i.SearchManager [main] shutting down VCQ, 1555278576447
2019-04-14 21:49:36,447 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 10 micro seconds
2019-04-14 21:49:36,447 INFO c.m.i.SearchManager [main] shutting down RCQ, 1555278576447
2019-04-14 21:49:36,447 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 11 micro seconds
2019-04-14 21:49:36,447 INFO c.m.i.SearchManager [main] COMPLETED LINES: -1
2019-04-14 21:49:36,448 INFO c.m.i.SearchManager [main] Query File: /mnt/c/Users/Feri73/Desktop/oreo-FSE_Artifact/clone-detector/index/4/query.file
2019-04-14 21:49:36,453 INFO c.m.i.SearchManager [main] creating indexes for /mnt/c/Users/Feri73/Desktop/oreo-FSE_Artifact/clone-detector/index/4/candidates.file
2019-04-14 21:49:36,453 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 15 micro seconds
2019-04-14 21:49:36,453 INFO c.m.i.SearchManager [main] indexes created
2019-04-14 21:49:36,453 INFO c.m.i.SearchManager [main] initializing channels
2019-04-14 21:49:36,454 INFO c.m.i.SearchManager [main] shutting down channels
2019-04-14 21:49:36,454 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 13 micro seconds
2019-04-14 21:49:36,454 INFO c.m.i.SearchManager [main] shutting down QLQ, 1555278576454
2019-04-14 21:49:36,454 INFO c.m.i.SearchManager [main] shutting down QBQ, 1555278576454
2019-04-14 21:49:36,454 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 13 micro seconds
2019-04-14 21:49:36,454 INFO c.m.i.SearchManager [main] shutting down QCQ, 1555278576454
2019-04-14 21:49:36,454 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 11 micro seconds
2019-04-14 21:49:36,454 INFO c.m.i.SearchManager [main] shutting down VCQ, 1555278576454
2019-04-14 21:49:36,454 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 10 micro seconds
2019-04-14 21:49:36,454 INFO c.m.i.SearchManager [main] shutting down RCQ, 1555278576454
2019-04-14 21:49:36,454 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 10 micro seconds
2019-04-14 21:49:36,454 INFO c.m.i.SearchManager [main] COMPLETED LINES: -1
2019-04-14 21:49:36,455 INFO c.m.i.SearchManager [main] Query File: /mnt/c/Users/Feri73/Desktop/oreo-FSE_Artifact/clone-detector/index/5/query.file
2019-04-14 21:49:36,461 INFO c.m.i.SearchManager [main] creating indexes for /mnt/c/Users/Feri73/Desktop/oreo-FSE_Artifact/clone-detector/index/5/candidates.file
2019-04-14 21:49:36,462 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 16 micro seconds
2019-04-14 21:49:36,462 INFO c.m.i.SearchManager [main] indexes created
2019-04-14 21:49:36,462 INFO c.m.i.SearchManager [main] initializing channels
2019-04-14 21:49:36,462 INFO c.m.i.SearchManager [main] shutting down channels
2019-04-14 21:49:36,462 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 16 micro seconds
2019-04-14 21:49:36,463 INFO c.m.i.SearchManager [main] shutting down QLQ, 1555278576462
2019-04-14 21:49:36,463 INFO c.m.i.SearchManager [main] shutting down QBQ, 1555278576463
2019-04-14 21:49:36,463 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 14 micro seconds
2019-04-14 21:49:36,463 INFO c.m.i.SearchManager [main] shutting down QCQ, 1555278576463
2019-04-14 21:49:36,463 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 10 micro seconds
2019-04-14 21:49:36,463 INFO c.m.i.SearchManager [main] shutting down VCQ, 1555278576463
2019-04-14 21:49:36,463 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 18 micro seconds
2019-04-14 21:49:36,463 INFO c.m.i.SearchManager [main] shutting down RCQ, 1555278576463
2019-04-14 21:49:36,463 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 12 micro seconds
2019-04-14 21:49:36,463 INFO c.m.i.SearchManager [main] COMPLETED LINES: -1
2019-04-14 21:49:36,463 INFO c.m.i.SearchManager [main] Query File: /mnt/c/Users/Feri73/Desktop/oreo-FSE_Artifact/clone-detector/index/6/query.file
2019-04-14 21:49:36,468 INFO c.m.i.SearchManager [main] creating indexes for /mnt/c/Users/Feri73/Desktop/oreo-FSE_Artifact/clone-detector/index/6/candidates.file
2019-04-14 21:49:36,469 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 26 micro seconds
2019-04-14 21:49:36,469 INFO c.m.i.SearchManager [main] indexes created
2019-04-14 21:49:36,469 INFO c.m.i.SearchManager [main] initializing channels
2019-04-14 21:49:36,469 INFO c.m.i.SearchManager [main] shutting down channels
2019-04-14 21:49:36,469 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 12 micro seconds
2019-04-14 21:49:36,469 INFO c.m.i.SearchManager [main] shutting down QLQ, 1555278576469
2019-04-14 21:49:36,470 INFO c.m.i.SearchManager [main] shutting down QBQ, 1555278576469
2019-04-14 21:49:36,470 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 11 micro seconds
2019-04-14 21:49:36,470 INFO c.m.i.SearchManager [main] shutting down QCQ, 1555278576470
2019-04-14 21:49:36,470 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 10 micro seconds
2019-04-14 21:49:36,470 INFO c.m.i.SearchManager [main] shutting down VCQ, 1555278576470
2019-04-14 21:49:36,470 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 11 micro seconds
2019-04-14 21:49:36,470 INFO c.m.i.SearchManager [main] shutting down RCQ, 1555278576470
2019-04-14 21:49:36,470 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 11 micro seconds
2019-04-14 21:49:36,470 INFO c.m.i.SearchManager [main] COMPLETED LINES: -1
2019-04-14 21:49:36,470 INFO c.m.i.SearchManager [main] shutting down channels
2019-04-14 21:49:36,470 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 7 micro seconds
2019-04-14 21:49:36,470 INFO c.m.i.SearchManager [main] shutting down QLQ, 1555278576470
2019-04-14 21:49:36,470 INFO c.m.i.SearchManager [main] shutting down QBQ, 1555278576470
2019-04-14 21:49:36,470 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 7 micro seconds
2019-04-14 21:49:36,470 INFO c.m.i.SearchManager [main] shutting down QCQ, 1555278576470
2019-04-14 21:49:36,470 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 8 micro seconds
2019-04-14 21:49:36,471 INFO c.m.i.SearchManager [main] shutting down VCQ, 1555278576471
2019-04-14 21:49:36,471 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 7 micro seconds
2019-04-14 21:49:36,471 INFO c.m.i.SearchManager [main] shutting down RCQ, 1555278576471
2019-04-14 21:49:36,471 INFO c.m.m.ThreadedChannel [main] time taken for shutdown: 7 micro seconds
2019-04-14 21:49:36,471 INFO c.m.i.SearchManager [main] signing off NODE_1
2019-04-14 21:49:36,474 DEBUG c.m.i.SearchManager [main] lock obtained? sun.nio.ch.FileLockImpl[0:9223372036854775807 exclusive valid]
2019-04-14 21:49:36,479 INFO c.m.i.SearchManager [main] NODES COMPLETED SO FAR: 1
2019-04-14 21:49:36,480 INFO c.m.i.SearchManager [main] Total run Time: 80870 micors
2019-04-14 21:49:36,480 INFO c.m.i.SearchManager [main] number of clone pairs detected: 0
2019-04-14 21:49:36,480 INFO c.m.i.SearchManager [main] moving /mnt/c/Users/Feri73/Desktop/oreo-FSE_Artifact/clone-detector/NODE_1/output6.0 to /mnt/c/Users/Feri73/Desktop/oreo-FSE_Artifact/clone-detector/backup_output/1/NODE_1
2019-04-14 21:49:36,490 INFO c.m.i.SearchManager [main] completed on NODE_1

farimaf commented

Hello,
Thank you for your interest in Oreo.
Please try the version in this link and let us know if the problem persists. Thank you!