Mellanox/libvma

NOT see any rocev2 packet

Closed this issue · 9 comments

Hi all,i run redis-benchmark with libvma,and expect the communication of redis using rocev2,here is my command:
Client: D_PRELOAD=/usr/lib64/libvma.so redis-benchmark -h 10.39.30.220 -p 6379 -c 1 -n 1000000 -t get
Server:LD_PRELOAD=/usr/lib64/libvma.so redis-server /etc/redis.conf
My HCA is mlx5,and show_gids,here is the output:
mlx5_2 1 3 0000:0000:0000:0000:0000:ffff:0a27:1ee7 10.39.30.231 v2 ens8

the redis communication is ok, but i can not see any rocev2 packets,seem like the libvma use something like cx5 blueflame,and transport with ethernet packet。

@forsakening can the issue be closed?

@igor-ivanov hi,i am using tcpdump-rdma,but the capture packet is all raw tcp packet,not rocev2 packet

so redis uses socket tcp connections and you see tcp packets.

@igor-ivanov ahhh,so libvma only use rdma verbs,but the underlay packet is raw Ethernet packet, not the rocev2 udp packet ?

libvma accelerates socket based application. See left branch on the picture.

image

@igor-ivanov yeah i know libvma call the rdma verbs ,but my test is under cx5 nic,and the packet is raw ethernet,not the rocev2 packet . in my opinion, libvma call rdma verbs , the packet shoule be rocev2 (under cx5).

no, vma forms tcp/udp packets and send them

@igor-ivanov thank you very much