FreeBSD network forwarding performance benchmark results
This repository includes bench scripts (need netmap pkt-gen and nanobsd like), bench configuration files, raw results and gnuplot graphs on few setups. Bench script documentation is available too.
Hardware benched are:
- Dell PowerEdgre R630 (2x12 cores Intel Xeon E5-2650 @ 2.2GHz) and: Intel 82599, Chelsio T520-CR, Mellanox ConnectX-3 and ConnectX-4
- HP ProLiant DL360p Gen8 (8 cores Intel Xeon E5-2650 @ 2.60GHz) and 10-Gigabit Chelsio T540-CR
- SuperMicro SuperServer 5018A-FTN4 (8 cores Atom C2758) and 10-Gigabit Chelsio T540-CR
- SuperMicro SuperServer 5018A-FTN4 (8 cores Atom C2758) and 10-Gigabit Intel 82599
- Netgate RCC-VE 4860 (4 cores Intel Atom C2558) and quad port Intel i350 (the 2 Intel i211 are not benched)
- PC Engines APU2C4 (4 cores AMD GX-412TC) and 4 Intel i210AT Gigabit NIC
Some results:
-
ipfw/pf/ipf's impact on forwarding performance:
- Impact of firewalls on forwarding performance with 2x12 cores Xeon E5-2650 & Mellanox ConnectX-4
- Impact of firewalls on forwarding performance with 8 cores Xeon E5-2650 & Chelsio T540
- Impact of firewalls on forwarding performance with 8 cores Atom C2758 & Chelsio T540
- Impact of firewalls on forwarding performance with 8 cores Atom C2758 & Intel 82599
- Impact of firewalls on forwarding performance with 4 cores Atom C2558 & Intel i350
- Impact of firewalls on forwarding performance with 4 cores AMD GX-412TC & Intel i210
- (old)Impact of firewalls on forwarding performance with 4 cores Xeon L5630
- (old)Impact of firewalls on forwarding performance with 2 cores AMD G-T40E
- One year (2017) of forwarding performance with 8 cores Xeon E5-2650 & Chelsio T540
- One year (2017) of forwarding performance with 4 cores Atom 2558 & Intel i350
- One year (2016) of forwarding performance with 8 cores Atom 2758 & Chelsio T540
- One year (2016) of forwarding performance with 4 cores Atom 2558 & Intel i350
- One year (2016) of forwarding performance with 4 cores AMD GX-412TC & Intel i210
- One year (2015) of fastforwarding performance evolution with with 8 cores Xeon E5-2650
- One year (2015) of fastforwarding performance evolution with 4 cores Atom C2558
-
comparing 12-head and 11-stable:
-
comparing 11.0 and 11.1-BETA1:
-
Impact of entropy sources:
- Impact of random.harvest.mask on forwarding performance with 8 cores Xeon E5-2650
- Impact of random.harvest.mask on forwarding performance with 8 cores Atom C2758
- Impact of random.harvest.mask on forwarding performance with 4 cores Atom C2558
- Impact of random.harvest.mask on forwarding performance with 4 cores AMD GX-412TC
-
Impact of adding VIMAGE support (without using it):
- Impact of adding VIMAGE on forwarding/pf/ipfw performance with 8 cores Xeon E5-2650
- Impact of adding VIMAGE on forwarding/pf/ipfw performance with 8 cores Atom C2758
- Impact of adding VIMAGE on forwarding/pf/ipfw performance with 4 cores Atom C2558
- Impact of adding VIMAGE on forwarding/pf/ipfw performance with 4 cores AMD GX-412TC
- Impact of adding VIMAGE on forwarding/pf/ipfw performance with 4 cores Xeon L5630
-
Impact of Intel's TurboBoost
-
Impact of a software bridge
-
Impact of enabling ALTQ
-
Impact of number of static routes:
-
Mellanox ConnectX-4 tuning:
-
Chelsio NIC T540-CR tuning:
- Impact of queue number on forwarding performance with 8 cores Xeon E5-2650
- Impact of queue number on forwarding performance with 8 cores Atom C2758
- Impact of disabling cxgbe.toecaps_allowed on forwarding performance with 8 cores Xeon E5-2650
- Impact of pinning IRQ queue to CPU with 8 cores Xeon E5-2650
- Impact of pinning IRQ queue to CPU with 8 cores Atom C2758
-
Intel 82599EB NIC tuning:
- Impact of Intel 82599EB queue number (1 queue per core) on forwarding performance with 4 cores Xeon L5630
- Impact of random.harvest.mask and Intel 82599EB queue number (1 queue per core) on forwarding performance with 4 cores Xeon L5630
- Impact of Intel 82599EB AIM on forwarding performance with 4 cores Xeon L5630
- Impact of Intel 82599EB Rx|Tx process limit on forwarding performance with 4 cores Xeon L5630
- Impact of Intel 82599EB descriptors per queue on forwarding performance with 4 cores Xeon L5630
- Impact of AIM on Intel 82599EB
-
Hyper Threading impact:
-
Intel i350 tuning:
-
Packet filter (pf) tuning:
-
ipfw tuning:
-
IPSec performance:
-
OpenVPN performance:
Synthesis: