Problems using faucet with Aruba 2930F
d-patch opened this issue · 4 comments
d-patch commented
Hi,
I am struggeling to correctly use faucet with my Aruba 2930F switches. It seems to work somehow sometimes, but not fully and not without problems. I'm hoping that you can help me find the issue with my setup.
I have followed the faucet documentation regarding the configuration of the Aruba 2930F switches.
Sometimes after changing the faucet config (adding vlans, interfaces or routers) and reloading or restarting faucet, there are suddenly lots of error messages like the ones below in the faucet.log. Also, it seems like the "openflow aggregate instance" doesn't have "full control" over the VLANs on the switch, as I can still use the switch CLI or GUI to configure VLANs.
Here is the output of the Aruba CLI concerning the openflow config:
Running configuration:
; JL254A Configuration Editor; Created on release #WC.16.11.0014
; Ver #14:67.6f.f8.1d.9b.3f.bf.bb.ef.7c.59.fc.6b.fb.9f.fc.ff.ff.37.ef:44
hostname "aruba-05"
module 1 type jl254a
logging 192.168.0.254
max-vlans 2048
timesync ntp
ntp unicast
ntp server 192.168.0.254 iburst
ntp enable
time daylight-time-rule western-europe
time timezone 60
ip ssh filetransfer
ip routing
snmp-server community "public" unrestricted
openflow
controller-id 1 ip 192.168.0.240 port 6663 controller-interface vlan 2048
instance aggregate
controller-id 1
version 1.3 only
max-backoff-interval 10
pipeline-model custom
packet-in vlan-tagging input-form
override-protocol all
enable
exit
enable
exit
vlan 1
name "DEFAULT_VLAN"
no untagged 1-52
no ip address
exit
vlan 2
name "VLAN2"
tagged 1-47,49-52
no ip address
exit
vlan 3
name "VLAN3"
tagged 1-47,49-52
no ip address
exit
[...]
aruba-05(config)# show openflow
OpenFlow : Enabled
Egress Only Ports Mode : Disabled
Instance Information
No. of No. of OpenFlow
Instance Name Oper. Status H/W Flows S/W Flows Version
--------------------------------- ------------ ---------- ---------- --------
aggregate Up 259 0 1.3 only
aruba-05(config)# show openflow flow-table
Flow Table Information
Refresh
Max. Rate Flow
Table Name Usage (seconds) Count
-------------------------------- ------ --------- -----
IP Control Table 50% 12 0
Policy Engine Table 50% 20 1818326388
IP Control Table Policy Engine Table
Slot ID Current Usage (%) Current Usage (%)
-------- ----------------- -------------------
1 0.000000 1.67
Note: Current usage is percentage of OpenFlow maximum usage
aruba-05(config)# show openflow instance aggregate
Configured OF Version : 1.3 only
Negotiated OF Version : 1.3
Instance Name : aggregate
Data-path Description : aggregate
Administrator Status : Enabled
Member List : VLAN 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36,
37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, [...] 1954, 1955, 1956, 1957, 1958, 1959, 1960, 1961, 1962, 1963, 1964, 1965, 1966, 1967, 1968, 1969, 1970, 1971, 1972, 1973, 1974, 1975, 1976, 1977, 1978, 1979, 1980, 1981,
1982, 1983, 1984, 1985, 1986, 1987, 1988, 1989, 1990, 1991, 1992, 1993, 1994, 1995, 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005, 2006, 2007, 2008, 2009,
2010, 2011, 2012, 2013, 2014, 2015, 2016, 2017, 2018, 2019, 2020, 2021, 2022, 2023, 2024, 2025, 2026, 2027, 2028, 2029, 2030, 2031, 2032, 2033, 2034, 2035, 2036, 2037,
2038, 2039, 2040, 2041, 2042, 2043, 2044, 2045, 2046, 2047
Pipeline Model : Custom
Listen Port : None
Operational Status : Up
Operational Status Reason : NA
Datapath ID : 0001883a30c88040
Mode : Active
Flow Location : Hardware Only
No. of Hardware Flows : 259
No. of Software Flows : 0
Hardware Rate Limit : 0 kbps
Software Rate Limit : 100 pps
Conn. Interrupt Mode : Fail-Secure
Maximum Backoff Interval : 10 seconds
Probe Interval : 10 seconds
Hardware Table Miss Count : NA
No. of Software Flow Tables : NA
Egress Only Ports : None
Table Model : Custom Pipeline
Source MAC Group Table : Disabled
Destination MAC Group Table : Disabled
Default Miss Action : Drop
Packet-In VLAN Tagging : Input Form
Controller Id Connection Status Connection State Secure Role
------------- ----------------- ---------------- ------ ------
1 Connected Active No Equal
aruba-05(config)# show openflow instance aggregate flow-table
OpenFlow Instance Flow Table Information
Table Flow Miss
ID Table Name Count Count Goto Table
----- --------------------- -------- ------------- -------------
0 vlan 8 1 1
1 eth_src 53 0 2, 3, 4, 5
2 ipv6_fib 65 0 3, 4, 5
3 vip 48 0 4, 5
4 eth_dst 1 0 *
5 flood 84 0 *
Table
ID Table Name Available Free Flow Count
----- --------------------- ------------------------------
0 vlan Ports 1-52 : 57
1 eth_src Ports 1-52 : 44
2 ipv6_fib Ports 1-52 : 0
3 vip Ports 1-52 : 113
4 eth_dst Ports 1-52 : 153
5 flood Ports 1-52 : 77
* Denotes that the pipeline could end here.
And here is the faucet.log containing the error message:
Jan 22 21:21:34 faucet INFO version 1.10.10
Jan 22 21:21:34 faucet INFO Reloading configuration
Jan 22 21:21:34 faucet INFO configuration /etc/faucet/faucet-aruba.yaml changed, analyzing differences
Jan 22 21:21:34 faucet INFO Add new datapath DPID 431258484637760 (0x1883a30c88040)
Jan 22 21:21:34 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 IPv6 routing is active on VLAN mgmt-wan vid:20 with VIPs ['2001:0:db8:10:172:16:0:254/
64']
Jan 22 21:21:34 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 IPv6 routing is active on VLAN remotea01-wan vid:21 with VIPs ['2001:0:db8:11:172:16:1
:254/64']
Jan 22 21:21:34 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 IPv6 routing is active on VLAN remotea02-wan vid:22 with VIPs ['2001:0:db8:12:172:16:2:254/64']
Jan 22 21:21:34 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 IPv6 routing is active on VLAN remoteb01-wan vid:23 with VIPs ['2001:0:db8:13:172:16:3:254/64']
Jan 22 21:21:34 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 IPv6 routing is active on VLAN remoteb02-wan vid:24 with VIPs ['2001:0:db8:14:172:16:4:254/64']
Jan 22 21:21:34 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 IPv6 routing is active on VLAN remotec01-wan vid:25 with VIPs ['2001:0:db8:15:172:16:5:254/64']
Jan 22 21:21:34 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 IPv6 routing is active on VLAN remotec02-wan vid:26 with VIPs ['2001:0:db8:16:172:16:6:254/64']
Jan 22 21:21:34 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 IPv6 routing is active on VLAN rz01-wan vid:27 with VIPs ['2001:0:db8:17:172:17:7:254/64']
Jan 22 21:21:34 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 IPv6 routing is active on VLAN rz02-wan vid:28 with VIPs ['2001:0:db8:18:172:18:8:254/64']
Jan 22 21:21:35 faucet ERROR <os_ken.controller.ofp_event.EventOFPSwitchFeatures object at 0x7f6ed930cdc0>: unknown datapath DPID 444618604606656 (0x19460d5fcf4c0)
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 port desc stats
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 delta in known ports: conf {49} dyn {1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 49, 50, 51, 52}
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 delta in up state: set() => {1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 49, 4294967294}
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 1 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 2 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 3 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 4 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 5 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 6 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 7 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 8 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 9 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 10 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 11 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 12 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 13 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 14 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 15 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 16 fabricating MODIFY status True
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 49 fabricating ADD status True
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 status change: Port 49 up status True reason ADD state 0
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 49 (49) up
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remotec01-red-transfer vid:85 tagged: Port 49
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remotec02-red-transfer vid:86 tagged: Port 49
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remoteb02-red-transfer vid:84 tagged: Port 49
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN mgmt-red-transfer vid:10 untagged: Port 49
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remotea02-red-transfer vid:82 tagged: Port 49
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remotea01-red-transfer vid:81 tagged: Port 49
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remoteb01-red-transfer vid:83 tagged: Port 49
Jan 22 21:21:35 faucet.valve ERROR DPID 431258484637760 (0x1883a30c88040) aruba-05 send_flow_msgs: DP not up
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Cold start configuring DP
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Port 49 (49) configured
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN mgmt-red-transfer vid:10 untagged: Port 49
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN mgmt-wan vid:20
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remotea01-wan vid:21
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remotea02-wan vid:22
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remoteb01-wan vid:23
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remoteb02-wan vid:24
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remotec01-wan vid:25
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remotec02-wan vid:26
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN rz01-wan vid:27
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN rz02-wan vid:28
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remotea01-red-transfer vid:81 tagged: Port 49
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remotea02-red-transfer vid:82 tagged: Port 49
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remoteb01-red-transfer vid:83 tagged: Port 49
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remoteb02-red-transfer vid:84 tagged: Port 49
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remotec01-red-transfer vid:85 tagged: Port 49
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 Configuring VLAN remotec02-red-transfer vid:86 tagged: Port 49
Jan 22 21:21:35 faucet.valve INFO DPID 431258484637760 (0x1883a30c88040) aruba-05 table ID 0 table config match_types: (('eth_dst', True), ('eth_type', False), ('in_port', False), ('vlan_vid', False)) name: vlan next_tables: ['eth_src'] output: True set_fields: ('vlan_vid',) size: 64 vlan_port_scale: 3
table ID 1 table config match_types: (('eth_dst', True), ('eth_src', False), ('eth_type', False), ('in_port', False), ('vlan_vid', False)) miss_goto: eth_dst name: eth_src next_tables: ['ipv6_fib', 'vip', 'eth_dst', 'flood'] output: True set_fields: ('vlan_vid', 'eth_dst') size: 96 table_id: 1 vlan_port_scale: 4.1
table ID 2 table config dec_ttl: True match_types: (('eth_type', False), ('ipv6_dst', True), ('vlan_vid', False)) name: ipv6_fib next_tables: ['vip', 'eth_dst', 'flood'] output: True set_fields: ('eth_dst', 'eth_src', 'vlan_vid') size: 64 table_id: 2 vlan_port_scale: 3.1
table ID 3 table config match_types: (('arp_tpa', False), ('eth_dst', False), ('eth_type', False), ('icmpv6_type', False), ('ip_proto', False)) name: vip next_tables: ['eth_dst', 'flood'] output: True size: 160 table_id: 3 vlan_scale: 8
table ID 4 table config exact_match: True match_types: (('eth_dst', False), ('vlan_vid', False)) miss_goto: flood name: eth_dst output: True size: 96 table_id: 4 vlan_port_scale: 4.1
table ID 5 table config match_types: (('eth_dst', True), ('in_port', False), ('vlan_vid', False)) name: flood output: True size: 160 table_id: 5 vlan_port_scale: 8.0
Jan 22 21:21:35 faucet.valve ERROR DPID 431258484637760 (0x1883a30c88040) aruba-05 OFError type: OFPET_FLOW_MOD_FAILED code: OFPFMFC_TABLE_FULL version=0x4,msg_type=0x1,msg_len=0x4c,xid=0x94d6a714,OFPErrorMsg(code=1,data=bytearray(b'\x04\x0e\x00p\x94\xd6\xa7\x14\x00\x00\x00\x00Z\xdc\x15\xc0\x00\x00\x00\x00\x00\x00\x00\x00\x02\x00\x00\x00\x00\x000@\xff\xff\xff\xff\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x004\x80\x00\n\x02\x86\xdd\x80\x00\x0c\x02\x10\x17'),type=5)
Jan 22 21:21:35 faucet.valve ERROR DPID 431258484637760 (0x1883a30c88040) aruba-05 OFError type: OFPET_FLOW_MOD_FAILED code: OFPFMFC_TABLE_FULL version=0x4,msg_type=0x1,msg_len=0x4c,xid=0x94d6a715,OFPErrorMsg(code=1,data=bytearray(b'\x04\x0e\x00p\x94\xd6\xa7\x15\x00\x00\x00\x00Z\xdc\x15\xc0\x00\x00\x00\x00\x00\x00\x00\x00\x02\x00\x00\x00\x00\x000@\xff\xff\xff\xff\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x004\x80\x00\n\x02\x86\xdd\x80\x00\x0c\x02\x10\x19'),type=5)
Jan 22 21:21:35 faucet.valve ERROR DPID 431258484637760 (0x1883a30c88040) aruba-05 OFError type: OFPET_FLOW_MOD_FAILED code: OFPFMFC_TABLE_FULL version=0x4,msg_type=0x1,msg_len=0x4c,xid=0x94d6a716,OFPErrorMsg(code=1,data=bytearray(b'\x04\x0e\x00p\x94\xd6\xa7\x16\x00\x00\x00\x00Z\xdc\x15\xc0\x00\x00\x00\x00\x00\x00\x00\x00\x02\x00\x00\x00\x00\x000@\xff\xff\xff\xff\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x004\x80\x00\n\x02\x86\xdd\x80\x00\x0c\x02\x10\x1a'),type=5)
Jan 22 21:21:35 faucet.valve ERROR DPID 431258484637760 (0x1883a30c88040) aruba-05 OFError type: OFPET_FLOW_MOD_FAILED code: OFPFMFC_TABLE_FULL version=0x4,msg_type=0x1,msg_len=0x4c,xid=0x94d6a717,OFPErrorMsg(code=1,data=bytearray(b'\x04\x0e\x00p\x94\xd6\xa7\x17\x00\x00\x00\x00Z\xdc\x15\xc0\x00\x00\x00\x00\x00\x00\x00\x00\x02\x00\x00\x00\x00\x000@\xff\xff\xff\xff\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x004\x80\x00\n\x02\x86\xdd\x80\x00\x0c\x02\x10\x16'),type=5)
Jan 22 21:21:35 faucet.valve ERROR DPID 431258484637760 (0x1883a30c88040) aruba-05 OFError type: OFPET_FLOW_MOD_FAILED code: OFPFMFC_TABLE_FULL version=0x4,msg_type=0x1,msg_len=0x4c,xid=0x94d6a718,OFPErrorMsg(code=1,data=bytearray(b'\x04\x0e\x00p\x94\xd6\xa7\x18\x00\x00\x00\x00Z\xdc\x15\xc0\x00\x00\x00\x00\x00\x00\x00\x00\x02\x00\x00\x00\x00\x000@\xff\xff\xff\xff\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x004\x80\x00\n\x02\x86\xdd\x80\x00\x0c\x02\x10\x14'),type=5)
Jan 22 21:21:35 faucet.valve ERROR DPID 431258484637760 (0x1883a30c88040) aruba-05 OFError type: OFPET_FLOW_MOD_FAILED code: OFPFMFC_TABLE_FULL version=0x4,msg_type=0x1,msg_len=0x4c,xid=0x94d6a719,OFPErrorMsg(code=1,data=bytearray(b'\x04\x0e\x00p\x94\xd6\xa7\x19\x00\x00\x00\x00Z\xdc\x15\xc0\x00\x00\x00\x00\x00\x00\x00\x00\x02\x00\x00\x00\x00\x000@\xff\xff\xff\xff\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x004\x80\x00\n\x02\x86\xdd\x80\x00\x0c\x02\x10\x1b'),type=5)
Jan 22 21:21:35 faucet.valve ERROR DPID 431258484637760 (0x1883a30c88040) aruba-05 OFError type: OFPET_FLOW_MOD_FAILED code: OFPFMFC_TABLE_FULL version=0x4,msg_type=0x1,msg_len=0x4c,xid=0x94d6a71a,OFPErrorMsg(code=1,data=bytearray(b'\x04\x0e\x00p\x94\xd6\xa7\x1a\x00\x00\x00\x00Z\xdc\x15\xc0\x00\x00\x00\x00\x00\x00\x00\x00\x02\x00\x00\x00\x00\x000@\xff\xff\xff\xff\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x004\x80\x00\n\x02\x86\xdd\x80\x00\x0c\x02\x10\x1c'),type=5)
Jan 22 21:21:35 faucet.valve ERROR DPID 431258484637760 (0x1883a30c88040) aruba-05 OFError type: OFPET_FLOW_MOD_FAILED code: OFPFMFC_TABLE_FULL version=0x4,msg_type=0x1,msg_len=0x4c,xid=0x94d6a71b,OFPErrorMsg(code=1,data=bytearray(b'\x04\x0e\x00p\x94\xd6\xa7\x1b\x00\x00\x00\x00Z\xdc\x15\xc0\x00\x00\x00\x00\x00\x00\x00\x00\x02\x00\x00\x00\x00\x000@\xff\xff\xff\xff\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x004\x80\x00\n\x02\x86\xdd\x80\x00\x0c\x02\x10\x18'),type=5)
[...]
There are a lot more of these error messages in the log. The "unknown datapath" message is from another switch, whose faucet config I erased, so you can ignore those.
And here is the corresponding faucet config:
---
vlans:
mgmt-wan:
vid: 20
faucet_mac: "0e:00:00:22:10:00"
faucet_vips:
- '2001:0:db8:10:172:16:0:254/64'
remotea01-wan:
vid: 21
faucet_mac: "0e:00:00:22:11:00"
faucet_vips:
- '2001:0:db8:11:172:16:1:254/64'
remotea02-wan:
vid: 22
faucet_mac: "0e:00:00:22:12:00"
faucet_vips:
- '2001:0:db8:12:172:16:2:254/64'
remoteb01-wan:
vid: 23
faucet_mac: "0e:00:00:22:13:00"
faucet_vips:
- '2001:0:db8:13:172:16:3:254/64'
remoteb02-wan:
vid: 24
faucet_mac: "0e:00:00:22:14:00"
faucet_vips:
- '2001:0:db8:14:172:16:4:254/64'
remotec01-wan:
vid: 25
faucet_mac: "0e:00:00:22:15:00"
faucet_vips:
- '2001:0:db8:15:172:16:5:254/64'
remotec02-wan:
vid: 26
faucet_mac: "0e:00:00:22:16:00"
faucet_vips:
- '2001:0:db8:16:172:16:6:254/64'
rz01-wan:
vid: 27
faucet_mac: "0e:00:00:22:17:00"
faucet_vips:
- '2001:0:db8:17:172:17:7:254/64'
rz02-wan:
vid: 28
faucet_mac: "0e:00:00:22:18:00"
faucet_vips:
- '2001:0:db8:18:172:18:8:254/64'
mgmt-red-transfer:
vid: 10
faucet_mac: "0e:00:00:22:20:00"
remotea01-red-transfer:
vid: 81
faucet_mac: "0e:00:00:22:21:00"
remotea02-red-transfer:
vid: 82
faucet_mac: "0e:00:00:22:22:00"
remoteb01-red-transfer:
vid: 83
faucet_mac: "0e:00:00:22:23:00"
remoteb02-red-transfer:
vid: 84
faucet_mac: "0e:00:00:22:24:00"
remotec01-red-transfer:
vid: 85
faucet_mac: "0e:00:00:22:25:00"
remotec02-red-transfer:
vid: 86
faucet_mac: "0e:00:00:22:26:00"
routers:
router-wan:
vlans: [mgmt-wan, remotea01-wan, remotea02-wan, remoteb01-wan, remoteb02-wan, remotec01-wan, remotec02-wan, rz01-wan, rz02-wan]
dps:
aruba-05:
dp_id: 0x0001883a30c88040
hardware: "Aruba"
interfaces:
49:
native_vlan: mgmt-red-transfer
tagged_vlans: [remotea01-red-transfer, remotea02-red-transfer, remoteb01-red-transfer, remoteb02-red-transfer, remotec01-red-transfer, remotec02-red-transfer]
I have also tried to "play around" with the setting port_table_scale_factor but I didn't know which values are sensible and testing some values didn't seem to make any difference, as the errors still occured.
Thanks in advance for your help!
gizmoguy commented
The error seems to indicate one of your openflow tables is full on the switch, you can manually adjust the size of the tables with the folllowing configuration to see if you can clear the error:
dps:
aruba-05:
dp_id: 0x0001883a30c88040
hardware: "Aruba"
table_sizes:
eth_dst: 1024
eth_src: 1024
flood: 512
port_acl: 256
vlan: 512
If that doesn't help you can enable debug mode on the aruba which will give you a better error message about why the error is occurring:
https://docs.faucet.nz/en/latest/vendors/hpe/README_Aruba.html#debug
d-patch commented
Unfortunately, that didn't seem to help. But when I remove the "routers" section in the config and restart faucet, the errors disappear and everything seems to work. Strange.
anarkiwi commented
I don't believe HPE support the dec TTL action, which we need to implement routing. Also, most hardware OF switches don't completely local disable VLAN processing. It would be ideal if they did, but generally they do not. At the end of the day Faucet can only program what the vendor implementation permits it to.
anarkiwi commented
https://docs.faucet.nz/en/latest/vendors/hpe/README_Aruba.html#debug will decode those errors for you. OpenFlow error messages don't have much scope for reason - as @gizmoguy mentioned, the switch is reporting out of resources. You'll have to enable debug on the Aruba to see why it says that. Fortunately its debug is very verbose and should explain what resource its lacking, which in turn will give you a clue about which table could be expanded - if possible.