Error running archive test ( -j 2)

[pradeepfn]

I tried running archive testcase from master branch code.

used the command: ./graphone32 -i ../data/ -j 2 -v 2097152

I generated kron21_16 as per the instructions in the project readme. Output filename turns out to be scale-21-rank-0-of-1-par-rowcol-0-0.dat ( in case it helps).

error output:

input dir = ../data/
Global vcount = 2097152
Threads Count = 111
Reading 1 file time = 0.271577
End marker = 62577182
batch_size = 1
graphone32: /home/cyclone/graph-one/src/edge_sharding.h:485: void edge_shard_t::estimate_classify(vid_t*, vid_t*, vid_t, vid_t) [with T = dst_id_t; vid_t = unsigned int]: Assertion `range < RANGE_COUNT' failed.
Aborted (core dumped)

[pradeep-k]

the generated dat files implies that you have generated a binary file. Try passing -s1 option and let me know if it works.

[pradeep-k]

This command line option worked:
./graphone32 -i ~/data/kron-21/bin/ -j 2 -v 2097152 -r 16 -s 1

pkumar@mira:~/src/GraphOne/build$ ./graphone32 -i ~/data/kron-21/bin/ -j 2 -v 2097152 -r 16 -s 1
input dir = /home/pkumar/data/kron-21/bin/
Global vcount = 2097152
residue (multi-purpose) value) = 16
Threads Count = 19
huge page alloc failed while reading input dir
 Batching Time = 0.703252 vertex count = 2097152
batch_size = 65536
Make graph time = 0.604159
static View creation = 0.002635
Top down = 1 Level = 1 Frontier Count = 3 Time = 0.000521898
Top down = 1 Level = 2 Frontier Count = 44249 Time = 0.00276303
Top down = 0 Level = 3 Frontier Count = 1039021 Time = 0.00717497
Top down = 0 Level = 4 Frontier Count = 159573 Time = 0.00213599
Top down = 0 Level = 5 Frontier Count = 669 Time = 0.000854969
Top down = 1 Level = 6 Frontier Count = 5 Time = 0.000349998
Top down = 1 Level = 7 Frontier Count = 0 Time = 0.000317812
BFS root = 1Time = 0.0144539
 Level = 1 count = 1
 Level = 2 count = 3
 Level = 3 count = 44249
 Level = 4 count = 1039021
 Level = 5 count = 159573
 Level = 6 count = 669
 Level = 7 count = 5
BFS complex = 0.015763
Huge page alloc failed for rank array
Huge page alloc failed for prior rank array
Huge page alloc failed for dset
Iteration Time = 0.045681
Iteration Time = 0.042238
Iteration Time = 0.0419421
Iteration Time = 0.0420911
Iteration Time = 0.041883
PR Time = 0.216936

static View creation = 0.00297213
Huge page alloc failed for rank array
Huge page alloc failed for prior rank array
Huge page alloc failed for dset
Iteration Time = 0.054496
Iteration Time = 0.0508211
Iteration Time = 0.0510321
Iteration Time = 0.0507472
Iteration Time = 0.050925
PR Time = 0.260931

starting 1 HOP
Sum = 140788863639 1 Hop Time = 0.00163507

[pradeep-k]

Here, -r 16 implies that you are interested in (1<<16) edges to be archived in each batch. '-s 1' implies that the input files are binary files.