F-Stack/f-stack

Nginx becomes unresponsive when running in the multiprocess mode on an AVX2 machine.

mulhome-com opened this issue · 1 comments

f-stack.conf
[dpdk]
lcore_mask=f
...

nginx.conf
worker_processes 4;
....

In the server

/usr/local/sbin/nginx

cat logs/error

EAL: Detected CPU lcores: 112
943 EAL: Detected NUMA nodes: 2
944 EAL: Detected static linkage of DPDK
945 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
946 EAL: Selected IOVA mode 'PA'
947 EAL: 2048 hugepages of size 2097152 reserved, but no mounted hugetlbfs found for that size
948 EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:17:00.1 (socket 0)
949 ice_load_pkg_type(): Active package is: 1.3.30.0, ICE OS Default Package (single VLAN mode)
950 EAL: Probe PCI driver: net_virtio (1af4:1000) device: 0000:b1:00.0 (socket 1)
951 eth_virtio_pci_init(): Failed to init PCI device
952 EAL: Requested device 0000:b1:00.0 cannot be used
953 TELEMETRY: No legacy callbacks, legacy socket not created
954 ice_set_rx_function(): Using AVX2 OFFLOAD Vector Rx (port 0).
955 ice_set_tx_function(): Using AVX2 OFFLOAD Vector Tx (port 0).

956 EAL: Detected CPU lcores: 112
957 EAL: Detected NUMA nodes: 2
958 EAL: Detected CPU lcores: 112
959 EAL: Detected NUMA nodes: 2
960 EAL: Detected static linkage of DPDK
961 EAL: Detected static linkage of DPDK
962 EAL: Detected CPU lcores: 112
963 EAL: Detected NUMA nodes: 2
964 EAL: Detected static linkage of DPDK
965 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket_91010_72a74e3ad5891
966 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket_91011_72a74e3b3ffd9
967 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket_91012_72a74e3b751e1
968 EAL: Selected IOVA mode 'PA'
969 EAL: Selected IOVA mode 'PA'
970 EAL: Selected IOVA mode 'PA'
971 EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:17:00.1 (socket 0)
972 ice_set_rx_function(): Using AVX2 OFFLOAD Vector Rx (port 0).
973 EAL: Probe PCI driver: net_virtio (1af4:1000) device: 0000:b1:00.0 (socket 1)
974 Device 0000:b1:00.0 is not driven by the primary process
975 EAL: Requested device 0000:b1:00.0 cannot be used
976 EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:17:00.1 (socket 0)
977 ice_set_rx_function(): Using AVX2 OFFLOAD Vector Rx (port 0).
978 EAL: Probe PCI driver: net_virtio (1af4:1000) device: 0000:b1:00.0 (socket 1)
979 Device 0000:b1:00.0 is not driven by the primary process
980 EAL: Requested device 0000:b1:00.0 cannot be used
981 EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:17:00.1 (socket 0)
982 ice_set_rx_function(): Using AVX2 OFFLOAD Vector Rx (port 0).
983 EAL: Probe PCI driver: net_virtio (1af4:1000) device: 0000:b1:00.0 (socket 1)
984 Device 0000:b1:00.0 is not driven by the primary process
985 EAL: Requested device 0000:b1:00.0 cannot be used

In the client

ifconfig eth0 192.168.1.3/23

curl http://192.168.1.2

Then the request is timeout without any response.

Actually, it work in the single process mode.
So how to fix this problem?
Thanks.

Which version of F-Stack are you using? It is recommended to try to upgrade the DPDK or F-Stack version first and then try again.

Or also try run DPDK's test domo in the multiprocess mode.