Problems with instructions of demo version
clijosor opened this issue · 12 comments
Hello,
When I arrived to this point (in the following lines) of the instructions of demo version I haven't got any file in the '/opt/vent' directory, I don´t know why...
"The Poseidon logs should start picking up the 2 hosts and begin capturing traffic. Once the hosts are moved into the mirroring section of the Poseidon logs you can look at the faucet.yaml file again and see that it got updated to start mirroring traffic. Additionally if you do docker ps
you still start to see ncapture containers running which are creating the PCAP files of the mirrored traffic. You can find those PCAP files in '/opt/vent_files'. Eventually after the captures have been processed and analyzed by the machine learning portion of Poseidon (about 5 minutes), you'll see results of the machine learning classification in the poseidon logs."
I would like to use poseidon for an university proyect.
When I installed poseidon I selected: Demo, Debug and 0 (for delete pcap files).
I've searched this file /var/log/vent/2019/10/11/cyberreboot-poseidon-v0.7.2.log and it contains:
"root@celia-M17xR4:/var/log/vent/2019/10/11# cat cyberreboot-poseidon-v0.7.2.log 2019-10-11T17:04:16+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: [ERROR] _AsyncBaseTransport._produce() failed, aborting connection: error=IndexError('pop from an empty deque'); sock=<socket.socket fd=9, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('172.18.0.15', 35060), raddr=('172.18.0.3', 5672)>; Caller's stack:
2019-10-11T17:04:16+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: Traceback (most recent call last):
2019-10-11T17:04:16+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 1097, in _on_socket_writable
2019-10-11T17:04:16+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._produce()
2019-10-11T17:04:16+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 822, in _produce
2019-10-11T17:04:16+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: chunk = self._tx_buffers.popleft()
2019-10-11T17:04:16+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: IndexError: pop from an empty deque
2019-10-11T17:04:16+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: Traceback (most recent call last):
2019-10-11T17:04:16+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 1097, in _on_socket_writable
2019-10-11T17:04:16+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._produce()
2019-10-11T17:04:16+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 822, in _produce
2019-10-11T17:04:16+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: chunk = self._tx_buffers.popleft()
2019-10-11T17:04:16+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: IndexError: pop from an empty deque
2019-10-11T17:04:16+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: [ERROR] Unexpected frame: <METHOD(['channel_number=1', 'frame_type=1', "method=<Basic.CancelOk(['consumer_tag=ctag1.b1d07d5b81204c1ea12e06523dd01ea3'])>"])>
2019-10-11T17:04:16+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: [ERROR] connection_lost: StreamLostError: ("Stream connection lost: IndexError('pop from an empty deque')",)
2019-10-11T17:04:16+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: [ERROR] Unexpected connection close detected: StreamLostError: ("Stream connection lost: IndexError('pop from an empty deque')",)
2019-10-11T17:04:16+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: [ERROR] BlockingConnection.close(200, 'Normal shutdown') called on closed connection.
2019-10-11T17:13:41+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: [ERROR] BcfProxy could not connect to https://CONTROLLER_IP:8443/api/v1/ because HTTPSConnectionPool(host='controller_ip', port=8443): Max retries exceeded with url: /api/v1/auth/login (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7fa6dec24390>: Failed to establish a new connection: [Errno -2] Name does not resolve'))
2019-10-11T17:18:19+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: [ERROR] Unexpected frame: <METHOD(['channel_number=1', 'frame_type=1', "method=<Basic.CancelOk(['consumer_tag=ctag1.6d3dd4dac664458b87daacdfabbc7416'])>"])>
2019-10-11T17:18:19+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: [ERROR] _AsyncBaseTransport._produce() failed, aborting connection: error=IndexError('pop from an empty deque'); sock=<socket.socket fd=9, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('172.18.0.15', 43930), raddr=('172.18.0.3', 5672)>; Caller's stack:
2019-10-11T17:18:19+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: Traceback (most recent call last):
2019-10-11T17:18:19+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 1097, in _on_socket_writable
2019-10-11T17:18:19+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._produce()
2019-10-11T17:18:19+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 822, in _produce
2019-10-11T17:18:19+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: chunk = self._tx_buffers.popleft()
2019-10-11T17:18:19+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: IndexError: pop from an empty deque
2019-10-11T17:18:19+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: Traceback (most recent call last):
2019-10-11T17:18:19+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 1097, in _on_socket_writable
2019-10-11T17:18:19+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._produce()
2019-10-11T17:18:19+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 822, in _produce
2019-10-11T17:18:19+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: chunk = self._tx_buffers.popleft()
2019-10-11T17:18:19+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: IndexError: pop from an empty deque
2019-10-11T17:18:19+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: [ERROR] connection_lost: StreamLostError: ("Stream connection lost: IndexError('pop from an empty deque')",)
2019-10-11T17:18:19+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: [ERROR] Unexpected connection close detected: StreamLostError: ("Stream connection lost: IndexError('pop from an empty deque')",)
2019-10-11T17:18:20+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: Exception in thread Thread-3:
2019-10-11T17:18:20+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: Traceback (most recent call last):
2019-10-11T17:18:20+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
2019-10-11T17:18:20+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self.run()
2019-10-11T17:18:20+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/threading.py", line 870, in run
2019-10-11T17:18:20+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._target(*self._args, **self._kwargs)
2019-10-11T17:18:20+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/blocking_connection.py", line 1866, in start_consuming
2019-10-11T17:18:20+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._process_data_events(time_limit=None)
2019-10-11T17:18:20+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/blocking_connection.py", line 2027, in _process_data_events
2019-10-11T17:18:20+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self.connection.process_data_events(time_limit=time_limit)
2019-10-11T17:18:20+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/blocking_connection.py", line 825, in process_data_events
2019-10-11T17:18:20+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._flush_output(common_terminator)
2019-10-11T17:18:20+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/blocking_connection.py", line 522, in _flush_output
2019-10-11T17:18:20+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: raise self._closed_result.value.error
2019-10-11T17:18:20+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: pika.exceptions.StreamLostError: Stream connection lost: IndexError('pop from an empty deque')
2019-10-11T17:18:20+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]:
2019-10-11T17:18:20+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: [ERROR] BlockingConnection.close(200, 'Normal shutdown') called on closed connection.
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: [ERROR] Unexpected frame: <METHOD(['channel_number=1', 'frame_type=1', "method=<Basic.CancelOk(['consumer_tag=ctag1.58eac9928eba4111917d44d50bb68116'])>"])>
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: [ERROR] _AsyncBaseTransport._produce() failed, aborting connection: error=IndexError('pop from an empty deque'); sock=<socket.socket fd=9, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('172.18.0.15', 44920), raddr=('172.18.0.3', 5672)>; Caller's stack:
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: Traceback (most recent call last):
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 1097, in _on_socket_writable
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._produce()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 822, in _produce
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: chunk = self._tx_buffers.popleft()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: IndexError: pop from an empty deque
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: Traceback (most recent call last):
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 1097, in _on_socket_writable
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._produce()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 822, in _produce
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: chunk = self._tx_buffers.popleft()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: IndexError: pop from an empty deque
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: [ERROR] _AsyncBaseTransport._produce() failed, aborting connection: error=IndexError('pop from an empty deque'); sock=<socket.socket fd=13, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('172.18.0.15', 44924), raddr=('172.18.0.3', 5672)>; Caller's stack:
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: Traceback (most recent call last):
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 1097, in _on_socket_writable
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._produce()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 822, in _produce
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: chunk = self._tx_buffers.popleft()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: IndexError: pop from an empty deque
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: Traceback (most recent call last):
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 1097, in _on_socket_writable
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._produce()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 822, in _produce
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: chunk = self._tx_buffers.popleft()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: IndexError: pop from an empty deque
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: [ERROR] connection_lost: StreamLostError: ("Stream connection lost: IndexError('pop from an empty deque')",)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: [ERROR] Unexpected connection close detected: StreamLostError: ("Stream connection lost: IndexError('pop from an empty deque')",)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: [ERROR] Wrapped func exited with exception. Caller's stack:
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: Traceback (most recent call last):
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 1097, in _on_socket_writable
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._produce()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 822, in _produce
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: chunk = self._tx_buffers.popleft()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: IndexError: pop from an empty deque
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]:
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: During handling of the above exception, another exception occurred:
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]:
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: Traceback (most recent call last):
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/diagnostic_utils.py", line 53, in log_exception_func_wrap
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: return func(*args, **kwargs)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 911, in _initiate_abort
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: 'non-_STATE_COMPLETED', self._state)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: AssertionError: ('_AsyncTransportBase._initate_abort() expected non-_STATE_COMPLETED', 4)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: Traceback (most recent call last):
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 1097, in _on_socket_writable
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._produce()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 822, in _produce
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: chunk = self._tx_buffers.popleft()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: IndexError: pop from an empty deque
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]:
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: During handling of the above exception, another exception occurred:
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]:
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: Traceback (most recent call last):
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/diagnostic_utils.py", line 53, in log_exception_func_wrap
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: return func(*args, **kwargs)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 911, in _initiate_abort
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: 'non-_STATE_COMPLETED', self._state)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: AssertionError: ('_AsyncTransportBase._initate_abort() expected non-_STATE_COMPLETED', 4)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: [ERROR] Wrapped func exited with exception. Caller's stack:
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: Traceback (most recent call last):
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 1097, in _on_socket_writable
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._produce()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 822, in _produce
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: chunk = self._tx_buffers.popleft()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: IndexError: pop from an empty deque
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]:
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: During handling of the above exception, another exception occurred:
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]:
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: Traceback (most recent call last):
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/diagnostic_utils.py", line 53, in log_exception_func_wrap
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: return func(*args, **kwargs)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 1108, in _on_socket_writable
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._initiate_abort(error)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/diagnostic_utils.py", line 53, in log_exception_func_wrap
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: return func(*args, **kwargs)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 911, in _initiate_abort
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: 'non-_STATE_COMPLETED', self._state)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: AssertionError: ('_AsyncTransportBase._initate_abort() expected non-_STATE_COMPLETED', 4)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: Traceback (most recent call last):
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 1097, in _on_socket_writable
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._produce()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 822, in _produce
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: chunk = self._tx_buffers.popleft()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: IndexError: pop from an empty deque
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]:
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: During handling of the above exception, another exception occurred:
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]:
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: Traceback (most recent call last):
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/diagnostic_utils.py", line 53, in log_exception_func_wrap
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: return func(*args, **kwargs)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 1108, in _on_socket_writable
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._initiate_abort(error)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/diagnostic_utils.py", line 53, in log_exception_func_wrap
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: return func(*args, **kwargs)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 911, in _initiate_abort
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: 'non-_STATE_COMPLETED', self._state)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: AssertionError: ('_AsyncTransportBase._initate_abort() expected non-_STATE_COMPLETED', 4)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: Exception in thread Thread-5:
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: Traceback (most recent call last):
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self.run()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/threading.py", line 870, in run
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._target(*self._args, **self._kwargs)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/blocking_connection.py", line 1866, in start_consuming
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._process_data_events(time_limit=None)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/blocking_connection.py", line 2027, in _process_data_events
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self.connection.process_data_events(time_limit=time_limit)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/blocking_connection.py", line 825, in process_data_events
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._flush_output(common_terminator)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/blocking_connection.py", line 513, in _flush_output
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._impl.ioloop.poll()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/select_connection.py", line 576, in poll
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._poller.poll()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/select_connection.py", line 1200, in poll
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._dispatch_fd_events(fd_event_map)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/select_connection.py", line 888, in _dispatch_fd_events
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._processing_fd_event_map.clear()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: AttributeError: 'NoneType' object has no attribute 'clear'
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]:
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: Exception in thread Thread-3:
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: Traceback (most recent call last):
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 1097, in _on_socket_writable
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._produce()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 822, in _produce
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: chunk = self._tx_buffers.popleft()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: IndexError: pop from an empty deque
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]:
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: During handling of the above exception, another exception occurred:
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]:
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: Traceback (most recent call last):
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self.run()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/threading.py", line 870, in run
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._target(*self._args, **self._kwargs)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/blocking_connection.py", line 1866, in start_consuming
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._process_data_events(time_limit=None)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/blocking_connection.py", line 2027, in _process_data_events
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self.connection.process_data_events(time_limit=time_limit)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/blocking_connection.py", line 825, in process_data_events
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._flush_output(common_terminator)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/blocking_connection.py", line 513, in _flush_output
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._impl.ioloop.poll()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/select_connection.py", line 576, in poll
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._poller.poll()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/select_connection.py", line 1200, in poll
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._dispatch_fd_events(fd_event_map)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/select_connection.py", line 904, in _dispatch_fd_events
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: handler(fileno, events)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/selector_ioloop_adapter.py", line 391, in _on_reader_writer_fd_events
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: callbacks.writer()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/diagnostic_utils.py", line 53, in log_exception_func_wrap
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: return func(*args, **kwargs)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 1108, in _on_socket_writable
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self._initiate_abort(error)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/diagnostic_utils.py", line 53, in log_exception_func_wrap
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: return func(*args, **kwargs)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/utils/io_services_utils.py", line 911, in _initiate_abort
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: 'non-_STATE_COMPLETED', self._state)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: AssertionError: ('_AsyncTransportBase._initate_abort() expected non-_STATE_COMPLETED', 4)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]:
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: [ERROR] BlockingConnection.close(200, 'Normal shutdown') called on closed connection.
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: Traceback (most recent call last):
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/poseidon/poseidon/main.py", line 964, in <module>
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: main(skip_rabbit=False)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/poseidon/poseidon/main.py", line 960, in main
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: pmain.shutdown()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/poseidon/poseidon/main.py", line 896, in shutdown
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: self.rabbit_channel_connection_local.close()
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: File "/usr/lib/python3.7/site-packages/pika/adapters/blocking_connection.py", line 786, in close
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: raise exceptions.ConnectionWrongStateError(msg)
2019-10-11T17:33:09+00:00 172.18.0.1 cyberreboot-poseidon-v0.7.2[2171]: pika.exceptions.ConnectionWrongStateError: BlockingConnection.close(200, 'Normal shutdown') called on closed connection."
I don't know what I'm doing wrong... I need help.
Thanks!!!
Hi @clijosor, can you show the output from doing poseidon system-logs
as well what /etc/poseidon/default.conf
has? I recommend updating to the latest version - v0.7.5. Also, what version of Docker and OS are you using?
Okey!
My poseidon logs are here: https://drive.google.com/drive/folders/1TMCQ9VyNBScJZaddgBBzk0Pr0N3Yi2EC?usp=sharing
Because are too long to write it here.
In /etc/poseidon/default.conf:
"# Generated from debconf - do not edit by hand, to change configuration options run: poseidon reconfig
logger_level=DEBUG
delete_pcap_files=0
controller_type=faucet
controller_uri=
controller_mirror_ports='{"switch-1":3}'
collector_nic=s1-eth3
reinvestigation_frequency=300"
My Os is:
"Distributor ID: Ubuntu
Description: Ubuntu 18.04.3 LTS
Release: 18.04
Codename: bionic"
And my Docker version:
"Client: Docker Engine - Community
Version: 19.03.2
API version: 1.40
Go version: go1.12.8
Git commit: 6a30dfc
Built: Thu Aug 29 05:29:11 2019
OS/Arch: linux/amd64
Experimental: false
Server: Docker Engine - Community
Engine:
Version: 19.03.2
API version: 1.40 (minimum version 1.12)
Go version: go1.12.8
Git commit: 6a30dfc
Built: Thu Aug 29 05:27:45 2019
OS/Arch: linux/amd64
Experimental: false
containerd:
Version: 1.2.6
GitCommit: 894b81a4b802e4eb2a91d1ce216b8817763c29fb
runc:
Version: 1.0.0-rc8
GitCommit: 425e105d5a03fabd737a126ad93d62a9eeede87f
docker-init:
Version: 0.18.0
GitCommit: fec3683"
Thanks!
That all looks fine - do you see anything in /var/log/faucet/faucet.log
or faucet_exception.log
?
In faucet_exception.log I don't see anything, I put the faucet.log in the previous link.
thanks for all!! But I don't understand why I don't have anything on /opt/vent_files??
I don't see anything in the faucet logs about event client connected
or configuration changes setting the ports to be mirrored which would be why you're not getting pcap files in /opt/vent_files. The demo version will start Faucet for you, but it looks like you might already have Faucet running independent of Poseidon? Poseidon needs specific environment variables set for Faucet as well as the rabbitmq_adapter, so it's easiest to let Poseidon start Faucet for you, if you plan to use them together.
Mmmm, I've done this:
- Add the following environment variables to the ~/.bashrc:
export FAUCET_EVENT_SOCK=1
export FAUCET_CONFIG_STAT_RELOAD=1 - Install mininet:
- sudo apt-get update- git clone git://github.com/mininet/mininet
- cd mininet/util
- ./install.sh -nfv
- I have installed the versions of python 2.7 and 3.5
- Install Docker:
- sudo apt-get update
- curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo apt-key add -
- sudo add-apt-repository "deb [arch=amd64] https://download.docker.com/linux/ubuntu $(lsb_release -cs) stable"
- sudo apt-get update
- apt-cache policy docker-ce
- sudo apt-get install -y docker-ce
- sudo systemctl status docker
- sudo usermod -aG docker $USER
- Install Faucet (https://docs.faucet.nz/en/latest/installation.html#installation-with-docker):
- sudo mkdir -p /etc/faucet- sudo touch /etc/faucet/faucet.yaml
- sudo mkdir -p /var/log/faucet/
- sudo docker pull faucet/faucet:latest
- sudo docker run -d
--name faucet
--restart=always
-v /etc/faucet/:/etc/faucet/
-v /var/log/faucet/:/var/log/faucet/
-p 6653:6653
-p 9302:9302
faucet/faucet - sudo docker run -it faucet/faucet faucet --help
- Finally, install Poseidon:
- sudo apt-get install -y apt-transport-https curl- curl -sLf "https://dl.cloudsmith.io/public/cyberreboot/poseidon/cfg/gpg/gpg.F9E23875C98A1F72.key" | sudo apt-key add -
- sudo add-apt-repository "deb [arch=amd64] https://dl.cloudsmith.io/public/cyberreboot/poseidon/deb/ubuntu $(lsb_release -cs) main"
- sudo apt-get update
- sudo apt-get install poseidon
***Version DEMO, DEBUG mode & delete 0 pcap files
Is it well done? Or should I have installed faucet differently?
Thaks for everything!!
Thanks for providing your process. When doing step 6 in demo mode it will install and start Faucet for you, so you don't need to do step 5. I think that is why things aren't working quite as expected for you.
Thanks, I'll uninstall Faucet and reconfigure poseidon! I hope it works correctly!
Hello,
I have done the following steps to get Faucet started by Poseidon and not on his own and I still have nothing in /opt/vent_files, I even do poseidon -p and nothing...
-
Firstly I stopped poseidon: poseidon -S
-
And I stopped every docker containers I had: docker stop $(docker ps -a -q)
-
After I erased all the docker containers: docker rm $(docker ps -a -q)
-
With the images of docker the same thing: docker rmi $(docker images -q)
-
I've checked that I had all the python modules installed in /opt/poseidon/requirements.txt and installed the missing ones with pip or pip3 (depending on the module...)
-
I started poseidon again: poseidon -s
-
And finally I reconfigured poseidon: poseidon -R
-
Version DEMO, DEBUG mode & delete 0 pcap files
Thanks for all!!
After doing the Poseidon reconfig did you have both Faucet and Poseidon docker containers running (they should be persistent)? If those were both running, did you then follow the demo instructions again (https://github.com/CyberReboot/poseidon/blob/master/docs/demo.txt)? If you look at the Faucet logs you should see L2 Learn events, and then if you look at the Poseidon logs you should see the endpoints get picked up. Once Poseidon picks up the endpoints, it will then update the Faucet config and start mirroring traffic which will then create a Docker container called ncapture
which will write out the files to /opt/vent_files
when they exit (5 minutes in demo mode).
Can you verify you're seeing all of those pieces building up to writing out the files?
Closing as no activity, and docs have been updated to address a lot of these potential issues. Please re-open if you're still running into problems.