Nginx becomes unresponsive when running in the multiprocess mode on an AVX2 machine.
mulhome-com opened this issue · 1 comments
f-stack.conf
[dpdk]
lcore_mask=f
...
nginx.conf
worker_processes 4;
....
In the server
/usr/local/sbin/nginx
cat logs/error
EAL: Detected CPU lcores: 112
943 EAL: Detected NUMA nodes: 2
944 EAL: Detected static linkage of DPDK
945 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
946 EAL: Selected IOVA mode 'PA'
947 EAL: 2048 hugepages of size 2097152 reserved, but no mounted hugetlbfs found for that size
948 EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:17:00.1 (socket 0)
949 ice_load_pkg_type(): Active package is: 1.3.30.0, ICE OS Default Package (single VLAN mode)
950 EAL: Probe PCI driver: net_virtio (1af4:1000) device: 0000:b1:00.0 (socket 1)
951 eth_virtio_pci_init(): Failed to init PCI device
952 EAL: Requested device 0000:b1:00.0 cannot be used
953 TELEMETRY: No legacy callbacks, legacy socket not created
954 ice_set_rx_function(): Using AVX2 OFFLOAD Vector Rx (port 0).
955 ice_set_tx_function(): Using AVX2 OFFLOAD Vector Tx (port 0).
956 EAL: Detected CPU lcores: 112
957 EAL: Detected NUMA nodes: 2
958 EAL: Detected CPU lcores: 112
959 EAL: Detected NUMA nodes: 2
960 EAL: Detected static linkage of DPDK
961 EAL: Detected static linkage of DPDK
962 EAL: Detected CPU lcores: 112
963 EAL: Detected NUMA nodes: 2
964 EAL: Detected static linkage of DPDK
965 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket_91010_72a74e3ad5891
966 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket_91011_72a74e3b3ffd9
967 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket_91012_72a74e3b751e1
968 EAL: Selected IOVA mode 'PA'
969 EAL: Selected IOVA mode 'PA'
970 EAL: Selected IOVA mode 'PA'
971 EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:17:00.1 (socket 0)
972 ice_set_rx_function(): Using AVX2 OFFLOAD Vector Rx (port 0).
973 EAL: Probe PCI driver: net_virtio (1af4:1000) device: 0000:b1:00.0 (socket 1)
974 Device 0000:b1:00.0 is not driven by the primary process
975 EAL: Requested device 0000:b1:00.0 cannot be used
976 EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:17:00.1 (socket 0)
977 ice_set_rx_function(): Using AVX2 OFFLOAD Vector Rx (port 0).
978 EAL: Probe PCI driver: net_virtio (1af4:1000) device: 0000:b1:00.0 (socket 1)
979 Device 0000:b1:00.0 is not driven by the primary process
980 EAL: Requested device 0000:b1:00.0 cannot be used
981 EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:17:00.1 (socket 0)
982 ice_set_rx_function(): Using AVX2 OFFLOAD Vector Rx (port 0).
983 EAL: Probe PCI driver: net_virtio (1af4:1000) device: 0000:b1:00.0 (socket 1)
984 Device 0000:b1:00.0 is not driven by the primary process
985 EAL: Requested device 0000:b1:00.0 cannot be used
In the client
ifconfig eth0 192.168.1.3/23
curl http://192.168.1.2
Then the request is timeout without any response.
Actually, it work in the single process mode.
So how to fix this problem?
Thanks.
Which version of F-Stack are you using? It is recommended to try to upgrade the DPDK or F-Stack version first and then try again.
Or also try run DPDK's test domo in the multiprocess mode.