microsoft/Freeflow

mlx4: Warning: BlueFlame available, but failed to mmap() BlueFlame page

xinxinh2020 opened this issue · 4 comments

xinxinh2020 commented

Hi,
when i run ib_send_bw with freeflow，there is a warning: BlueFlame available, but failed to mmap() BlueFlame page, just like :
image
does this matters? becuase the ib_send_bw hangs after that, and can not get the result, i wander if this warning is related to the problem.
image

rhiswell commented

Check if FFL and FFR successfully share the same SHMEM IPC namespace, ie /dev/shm/*, otherwise ib_send_bw will be stuck since they use SHMEM to do some data-path operations when ffrouter working in fast-path mode.

Note that -e --ipc=container:router1 makes --ipc=container:router1 an environment variable instead of reusing router1's IPC namespace, so you'd better remove -e to fix it.

PS This has nothing to do with the warning you mentioned.

xinxinh2020 commented

Thanks very much for your helpful advice.
I follow your suggest to remove -e and it works!
Now, I have another question : How can i use low-cpu mode instead of fast-path mode?

rhiswell commented

Just export environment variable DISABLE_FASTPATH=1 in FFL. More details can refer to here https://github.com/microsoft/Freeflow/blob/master/libraries/libibverbs-1.2.1mlnx1/src/cmd.c#L656

xinxinh2020 commented

i got it . Thanks for you patient reply.