powa-collector is not able to connect to remote server, after RHEL8 upgrade
Closed this issue · 23 comments
I have a remote setup which used to work fine on RHEL7. After upgrade to RHEL8, having problems. When starting powa-collector, the log file displays list of workers, but says no connection to remote server for each of them.
I have verified the remote server has the pg_hba entry correctly configured.
I recompiled powa collector without errors.
Thanks
Hari
Hi,
There should be an error in the postgres logs of the remote explaining why the connection failed. If not, it means that the collector somehow could not try to connect (wrong IP/port, firewall or something). Can you check which one it is?
Strange thing is I do not see any error in the postgres logs of the remote server. I did verify firewall is open on the port from repository to remote server, In fact, I'm able to do psql using -h option to connect to remote server from the repository server.
Thanks
Hari
did you double check that the host and port are exactly the same as defined in the powa_servers table on the repository server?
also, is the collector running on the same machine as the repository server?
also, the collector should give the full connection error info, can you share it?
Here are the messages when starting up powa-collector daemon. I have removed password column from below message. Anyway, trust authentication is enabled for this repository server on the remote servers.
2024-03-19 03:50:05,416 - INFO : Starting powa-collector...
2024-03-19 03:50:05,439 sl73togadbp001:5432 INFO : Starting worker
2024-03-19 03:50:05,443 sl73spiiqdbp010:5432 INFO : Starting worker
2024-03-19 03:50:05,445 sl73scmdbp023:5432 INFO : Starting worker
2024-03-19 03:50:05,448 - INFO : List of workers:
2024-03-19 03:50:05,449 - INFO : sl73togadbp001:5432: {'host': 'sl73togadbp001', 'port': 5432, 'user': 'postgres', 'dbname': 'postgres'} (no connection to remote server)
2024-03-19 03:50:05,449 - INFO : sl73scmdbp023:5432: {'host': 'sl73scmdbp023', 'port': 5432, 'user': 'postgres', 'dbname': 'postgres'} (no connection to remote server)
Thanks
Hari
Below is how it is configured inside the powa database in repository server.
powa=# select id, hostname,alias,port,username, dbname, frequency,retention from powa_servers;
id | hostname | alias | port | username | dbname | frequency | retention
----+-----------------+------------------------+------+----------+----------+-----------+-----------
0 | | | 0 | | | -1 | 00:00:00
2 | sl73togadbp001 | TGS-PROD-OCE1 | 5432 | postgres | postgres | 300 | 7 days
5 | sl73scmdbp023 | SCM Bitbucket Prod OCE | 5432 | postgres | postgres | 300 | 7 days
(3 rows)
2024-03-19 03:50:05,416 - INFO : Starting powa-collector...
2024-03-19 03:50:05,439 sl73togadbp001:5432 INFO : Starting worker
2024-03-19 03:50:05,443 sl73spiiqdbp010:5432 INFO : Starting worker
2024-03-19 03:50:05,445 sl73scmdbp023:5432 INFO : Starting worker
2024-03-19 03:50:05,448 - INFO : List of workers:
2024-03-19 03:50:05,449 - INFO : sl73togadbp001:5432: {'host': 'sl73togadbp001', 'port': 5432, 'user': 'postgres', 'dbname': 'postgres'} (no connection to remote server)
2024-03-19 03:50:05,449 - INFO : sl73scmdbp023:5432: {'host': 'sl73scmdbp023', 'port': 5432, 'user': 'postgres', 'dbname': 'postgres'} (no connection to remote server)
this is expected, this shows the status of workers just after their creation, but they didn't need to connect to the remote servers yet, so there's no remote connection.
do you actually hit an error when trying to perform a snapshot, which is when the worker will try to connect if there isn't a connection?
Ok got it. I had to recompile powa-web also, after the RHEL upgrade. However, getting errors during build install.
I still tried starting up powa-web, but it exits with error (bottom of this thread).
Downloaded and installed SQLAlchemy-0.9.9
Downloaded and installed tornado-4.0
[root@sl73pgtldbp001 powa-web-4.1.1]# python setup.py build
running build
running build_py
copying powa/options.py -> build/lib/powa
copying powa/user.py -> build/lib/powa
running egg_info
writing powa_web.egg-info/PKG-INFO
writing dependency_links to powa_web.egg-info/dependency_links.txt
writing requirements to powa_web.egg-info/requires.txt
writing top-level names to powa_web.egg-info/top_level.txt
reading manifest file 'powa_web.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no previously-included files found matching 'powa/templates/'
writing manifest file 'powa_web.egg-info/SOURCES.txt'
running build_scripts
creating build/scripts-3.6
copying and adjusting powa-web -> build/scripts-3.6
changing mode of build/scripts-3.6/powa-web from 644 to 755
[root@sl73pgtldbp001 powa-web-4.1.1]#
[root@sl73pgtldbp001 powa-web-4.1.1]# python setup.py build install
running build
running build_py
running egg_info
writing powa_web.egg-info/PKG-INFO
writing dependency_links to powa_web.egg-info/dependency_links.txt
writing requirements to powa_web.egg-info/requires.txt
writing top-level names to powa_web.egg-info/top_level.txt
reading manifest file 'powa_web.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no previously-included files found matching 'powa/templates/'
writing manifest file 'powa_web.egg-info/SOURCES.txt'
running build_scripts
running install
running bdist_egg
installing library code to build/bdist.linux-x86_64/egg
running install_lib
creating build/bdist.linux-x86_64/egg
creating build/bdist.linux-x86_64/egg/powa
copying build/lib/powa/init.py -> build/bdist.linux-x86_64/egg/powa
copying build/lib/powa/collector.py -> build/bdist.linux-x86_64/egg/powa
copying build/lib/powa/compat.py -> build/bdist.linux-x86_64/egg/powa
copying build/lib/powa/config.py -> build/bdist.linux-x86_64/egg/powa
copying build/lib/powa/dashboards.py -> build/bdist.linux-x86_64/egg/powa
copying build/lib/powa/database.py -> build/bdist.linux-x86_64/egg/powa
copying build/lib/powa/framework.py -> build/bdist.linux-x86_64/egg/powa
copying build/lib/powa/json.py -> build/bdist.linux-x86_64/egg/powa
copying build/lib/powa/overview.py -> build/bdist.linux-x86_64/egg/powa
copying build/lib/powa/qual.py -> build/bdist.linux-x86_64/egg/powa
copying build/lib/powa/query.py -> build/bdist.linux-x86_64/egg/powa
copying build/lib/powa/server.py -> build/bdist.linux-x86_64/egg/powa
copying build/lib/powa/ui_methods.py -> build/bdist.linux-x86_64/egg/powa
copying build/lib/powa/ui_modules.py -> build/bdist.linux-x86_64/egg/powa
copying build/lib/powa/wizard.py -> build/bdist.linux-x86_64/egg/powa
creating build/bdist.linux-x86_64/egg/powa/sql
copying build/lib/powa/sql/init.py -> build/bdist.linux-x86_64/egg/powa/sql
copying build/lib/powa/sql/compat.py -> build/bdist.linux-x86_64/egg/powa/sql
copying build/lib/powa/sql/tables.py -> build/bdist.linux-x86_64/egg/powa/sql
copying build/lib/powa/sql/utils.py -> build/bdist.linux-x86_64/egg/powa/sql
copying build/lib/powa/sql/views.py -> build/bdist.linux-x86_64/egg/powa/sql
copying build/lib/powa/powa.wsgi -> build/bdist.linux-x86_64/egg/powa
creating build/bdist.linux-x86_64/egg/powa/static
creating build/bdist.linux-x86_64/egg/powa/static/css
copying build/lib/powa/static/css/foundation-icons.eot -> build/bdist.linux-x86_64/egg/powa/static/css
copying build/lib/powa/static/css/foundation-icons.svg -> build/bdist.linux-x86_64/egg/powa/static/css
copying build/lib/powa/static/css/foundation-icons.ttf -> build/bdist.linux-x86_64/egg/powa/static/css
copying build/lib/powa/static/css/foundation-icons.woff -> build/bdist.linux-x86_64/egg/powa/static/css
copying build/lib/powa/static/css/powa-all.min.css -> build/bdist.linux-x86_64/egg/powa/static/css
copying build/lib/powa/static/css/powa-all.min.css.map -> build/bdist.linux-x86_64/egg/powa/static/css
copying build/lib/powa/static/css/translucent.css -> build/bdist.linux-x86_64/egg/powa/static/css
creating build/bdist.linux-x86_64/egg/powa/static/img
copying build/lib/powa/static/img/powa-logo-white.png -> build/bdist.linux-x86_64/egg/powa/static/img
creating build/bdist.linux-x86_64/egg/powa/static/img/favicon
copying build/lib/powa/static/img/favicon/apple-touch-icon-114x114.png -> build/bdist.linux-x86_64/egg/powa/static/img/favicon
copying build/lib/powa/static/img/favicon/apple-touch-icon-120x120.png -> build/bdist.linux-x86_64/egg/powa/static/img/favicon
copying build/lib/powa/static/img/favicon/apple-touch-icon-144x144.png -> build/bdist.linux-x86_64/egg/powa/static/img/favicon
copying build/lib/powa/static/img/favicon/apple-touch-icon-152x152.png -> build/bdist.linux-x86_64/egg/powa/static/img/favicon
copying build/lib/powa/static/img/favicon/apple-touch-icon-57x57.png -> build/bdist.linux-x86_64/egg/powa/static/img/favicon
copying build/lib/powa/static/img/favicon/apple-touch-icon-60x60.png -> build/bdist.linux-x86_64/egg/powa/static/img/favicon
copying build/lib/powa/static/img/favicon/apple-touch-icon-72x72.png -> build/bdist.linux-x86_64/egg/powa/static/img/favicon
copying build/lib/powa/static/img/favicon/apple-touch-icon-76x76.png -> build/bdist.linux-x86_64/egg/powa/static/img/favicon
copying build/lib/powa/static/img/favicon/apple-touch-icon-precomposed.png -> build/bdist.linux-x86_64/egg/powa/static/img/favicon
copying build/lib/powa/static/img/favicon/apple-touch-icon.png -> build/bdist.linux-x86_64/egg/powa/static/img/favicon
copying build/lib/powa/static/img/favicon/browserconfig.xml -> build/bdist.linux-x86_64/egg/powa/static/img/favicon
copying build/lib/powa/static/img/favicon/favicon-160x160.png -> build/bdist.linux-x86_64/egg/powa/static/img/favicon
copying build/lib/powa/static/img/favicon/favicon-16x16.png -> build/bdist.linux-x86_64/egg/powa/static/img/favicon
copying build/lib/powa/static/img/favicon/favicon-196x196.png -> build/bdist.linux-x86_64/egg/powa/static/img/favicon
copying build/lib/powa/static/img/favicon/favicon-32x32.png -> build/bdist.linux-x86_64/egg/powa/static/img/favicon
copying build/lib/powa/static/img/favicon/favicon-96x96.png -> build/bdist.linux-x86_64/egg/powa/static/img/favicon
copying build/lib/powa/static/img/favicon/favicon.ico -> build/bdist.linux-x86_64/egg/powa/static/img/favicon
copying build/lib/powa/static/img/favicon/mstile-144x144.png -> build/bdist.linux-x86_64/egg/powa/static/img/favicon
copying build/lib/powa/static/img/favicon/mstile-150x150.png -> build/bdist.linux-x86_64/egg/powa/static/img/favicon
copying build/lib/powa/static/img/favicon/mstile-310x150.png -> build/bdist.linux-x86_64/egg/powa/static/img/favicon
copying build/lib/powa/static/img/favicon/mstile-310x310.png -> build/bdist.linux-x86_64/egg/powa/static/img/favicon
copying build/lib/powa/static/img/favicon/mstile-70x70.png -> build/bdist.linux-x86_64/egg/powa/static/img/favicon
creating build/bdist.linux-x86_64/egg/powa/static/js
copying build/lib/powa/static/js/config.js -> build/bdist.linux-x86_64/egg/powa/static/js
copying build/lib/powa/static/js/powa.min-all.js -> build/bdist.linux-x86_64/egg/powa/static/js
copying build/lib/powa/static/js/require.js -> build/bdist.linux-x86_64/egg/powa/static/js
creating build/bdist.linux-x86_64/egg/powa/templates
copying build/lib/powa/templates/fullpage_dashboard.html -> build/bdist.linux-x86_64/egg/powa/templates
copying build/lib/powa/templates/index.html -> build/bdist.linux-x86_64/egg/powa/templates
copying build/lib/powa/templates/layout.html -> build/bdist.linux-x86_64/egg/powa/templates
copying build/lib/powa/templates/login.html -> build/bdist.linux-x86_64/egg/powa/templates
copying build/lib/powa/templates/messages.html -> build/bdist.linux-x86_64/egg/powa/templates
copying build/lib/powa/templates/navigation.html -> build/bdist.linux-x86_64/egg/powa/templates
copying build/lib/powa/templates/xhr.html -> build/bdist.linux-x86_64/egg/powa/templates
copying build/lib/powa/templates/xhrm.html -> build/bdist.linux-x86_64/egg/powa/templates
creating build/bdist.linux-x86_64/egg/powa/templates/config
copying build/lib/powa/templates/config/allcollectors.html -> build/bdist.linux-x86_64/egg/powa/templates/config
copying build/lib/powa/templates/config/serverserror.html -> build/bdist.linux-x86_64/egg/powa/templates/config
creating build/bdist.linux-x86_64/egg/powa/templates/database
copying build/lib/powa/templates/database/nowizard.html -> build/bdist.linux-x86_64/egg/powa/templates/database
copying build/lib/powa/templates/database/wizard.html -> build/bdist.linux-x86_64/egg/powa/templates/database
copying build/lib/powa/templates/database/wizardthisdatabase.html -> build/bdist.linux-x86_64/egg/powa/templates/database
creating build/bdist.linux-x86_64/egg/powa/templates/database/query
copying build/lib/powa/templates/database/query/detail.html -> build/bdist.linux-x86_64/egg/powa/templates/database/query
copying build/lib/powa/templates/database/query/explains.html -> build/bdist.linux-x86_64/egg/powa/templates/database/query
copying build/lib/powa/templates/database/query/indexes.html -> build/bdist.linux-x86_64/egg/powa/templates/database/query
copying build/lib/powa/templates/database/query/qualdetail.html -> build/bdist.linux-x86_64/egg/powa/templates/database/query
copying build/lib/powa/options.py -> build/bdist.linux-x86_64/egg/powa
copying build/lib/powa/user.py -> build/bdist.linux-x86_64/egg/powa
byte-compiling build/bdist.linux-x86_64/egg/powa/init.py to init.cpython-36.pyc
byte-compiling build/bdist.linux-x86_64/egg/powa/collector.py to collector.cpython-36.pyc
byte-compiling build/bdist.linux-x86_64/egg/powa/compat.py to compat.cpython-36.pyc
byte-compiling build/bdist.linux-x86_64/egg/powa/config.py to config.cpython-36.pyc
byte-compiling build/bdist.linux-x86_64/egg/powa/dashboards.py to dashboards.cpython-36.pyc
byte-compiling build/bdist.linux-x86_64/egg/powa/database.py to database.cpython-36.pyc
byte-compiling build/bdist.linux-x86_64/egg/powa/framework.py to framework.cpython-36.pyc
byte-compiling build/bdist.linux-x86_64/egg/powa/json.py to json.cpython-36.pyc
byte-compiling build/bdist.linux-x86_64/egg/powa/overview.py to overview.cpython-36.pyc
byte-compiling build/bdist.linux-x86_64/egg/powa/qual.py to qual.cpython-36.pyc
byte-compiling build/bdist.linux-x86_64/egg/powa/query.py to query.cpython-36.pyc
byte-compiling build/bdist.linux-x86_64/egg/powa/server.py to server.cpython-36.pyc
byte-compiling build/bdist.linux-x86_64/egg/powa/ui_methods.py to ui_methods.cpython-36.pyc
byte-compiling build/bdist.linux-x86_64/egg/powa/ui_modules.py to ui_modules.cpython-36.pyc
byte-compiling build/bdist.linux-x86_64/egg/powa/wizard.py to wizard.cpython-36.pyc
byte-compiling build/bdist.linux-x86_64/egg/powa/sql/init.py to init.cpython-36.pyc
byte-compiling build/bdist.linux-x86_64/egg/powa/sql/compat.py to compat.cpython-36.pyc
byte-compiling build/bdist.linux-x86_64/egg/powa/sql/tables.py to tables.cpython-36.pyc
byte-compiling build/bdist.linux-x86_64/egg/powa/sql/utils.py to utils.cpython-36.pyc
byte-compiling build/bdist.linux-x86_64/egg/powa/sql/views.py to views.cpython-36.pyc
byte-compiling build/bdist.linux-x86_64/egg/powa/options.py to options.cpython-36.pyc
byte-compiling build/bdist.linux-x86_64/egg/powa/user.py to user.cpython-36.pyc
Sorry: TabError: inconsistent use of tabs and spaces in indentation (user.py, line 17)
creating build/bdist.linux-x86_64/egg/EGG-INFO
installing scripts to build/bdist.linux-x86_64/egg/EGG-INFO/scripts
running install_scripts
creating build/bdist.linux-x86_64/egg/EGG-INFO/scripts
copying build/scripts-3.6/powa-web -> build/bdist.linux-x86_64/egg/EGG-INFO/scripts
changing mode of build/bdist.linux-x86_64/egg/EGG-INFO/scripts/powa-web to 755
copying powa_web.egg-info/PKG-INFO -> build/bdist.linux-x86_64/egg/EGG-INFO
copying powa_web.egg-info/SOURCES.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
copying powa_web.egg-info/dependency_links.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
copying powa_web.egg-info/requires.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
copying powa_web.egg-info/top_level.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
zip_safe flag not set; analyzing archive contents...
powa.pycache.init.cpython-36: module references file
powa.pycache.dashboards.cpython-36: module MAY be using inspect.stack
creating 'dist/powa_web-4.1.1-py3.6.egg' and adding 'build/bdist.linux-x86_64/egg' to it
removing 'build/bdist.linux-x86_64/egg' (and everything under it)
Processing powa_web-4.1.1-py3.6.egg
removing '/usr/local/lib/python3.6/site-packages/powa_web-4.1.1-py3.6.egg' (and everything under it)
creating /usr/local/lib/python3.6/site-packages/powa_web-4.1.1-py3.6.egg
Extracting powa_web-4.1.1-py3.6.egg to /usr/local/lib/python3.6/site-packages
Sorry: TabError: inconsistent use of tabs and spaces in indentation (user.py, line 17)
powa-web 4.1.1 is already the active version in easy-install.pth
Installing powa-web script to /usr/local/bin
Installed /usr/local/lib/python3.6/site-packages/powa_web-4.1.1-py3.6.egg
Processing dependencies for powa-web==4.1.1
Searching for psycopg2==2.7.5
Best match: psycopg2 2.7.5
Adding psycopg2 2.7.5 to easy-install.pth file
Using /usr/lib64/python3.6/site-packages
Searching for tornado==4.0
Best match: tornado 4.0
Processing tornado-4.0-py3.6-linux-x86_64.egg
Adding tornado 4.0 to easy-install.pth file
Using /usr/local/lib64/python3.6/site-packages/tornado-4.0-py3.6-linux-x86_64.egg
Searching for SQLAlchemy==0.9.9
Best match: SQLAlchemy 0.9.9
Processing SQLAlchemy-0.9.9-py3.6-linux-x86_64.egg
Adding SQLAlchemy 0.9.9 to easy-install.pth file
Using /usr/local/lib64/python3.6/site-packages/SQLAlchemy-0.9.9-py3.6-linux-x86_64.egg
Searching for certifi==2020.4.5.1
Best match: certifi 2020.4.5.1
Processing certifi-2020.4.5.1-py3.6.egg
certifi 2020.4.5.1 is already the active version in easy-install.pth
Using /usr/local/lib/python3.6/site-packages/certifi-2020.4.5.1-py3.6.egg
Finished processing dependencies for powa-web==4.1.1
[root@sl73pgtldbp001 powa-web-4.1.1]#
cd /pgbin/powa/powa-web-4.1.1
[root@sl73pgtldbp001 powa-web-4.1.1]# nohup ./powa-web &
[root@sl73pgtldbp001 powa-web-4.1.1]# cat nohup.out
Traceback (most recent call last):
File "./powa-web", line 2, in
from powa import make_app
File "/pgbin/powa/powa-web-4.1.1/powa/init.py", line 15, in
from tornado.web import Application, URLSpec as U
ModuleNotFoundError: No module named 'tornado'
Traceback (most recent call last):
File "./powa-web", line 2, in
from powa import make_app
File "/pgbin/powa/powa-web-4.1.1/powa/init.py", line 20, in
from powa.user import LoginHandler, LogoutHandler
File "/pgbin/powa/powa-web-4.1.1/powa/user.py", line 17
expires_days = options.cookie_expires_days
^
TabError: inconsistent use of tabs and spaces in indentation
I'm really confused with that. First, the mentioned code landed in version 4.1.3, but you seem to be working on version 4.1.1. Which version / commit are you using? Or do you have some custom patch?
Then, there isn't a single tab in the powa/user.py file, and nothing wrong that I can see with the number of spaces either around that line in versions 4.1.3+.
I'm also confused now. Couple years ago, with reference to #134, there was issue with 4.1.1 version related to tornado, and I had to install tornado 4.0 to make it work, Not sure if I installed any custom patch based on my previous tickets.
Anyways, do you recommend me to download and install powa-web 4.1.3 and see if this fixes the issue?
I would recommend trying version 4.1.4 if you want to stay with powa 4.1, or even 4.2.0 if you have pg_stat_statements > 1.9 (and then switch to powa-archivist 4.2.2).
Let me try web version 4.1.4. Majority of remote DB servers are in 12.x and 14.x versions using powa-archivist 4.1.2 and pg_stat_statements 1.9. So makes sense to stick with 4.1.4 web version for now.
web 4.1.4 worked fine.
However I'm having issue with another repository server for Non-Prod servers.
I followed same steps there to install and compile 4.1.4
However the UI screen is blank, and does not show the DB servers.
There is one server registered.
powa=# select id, hostname,alias,port,username,password, dbname, frequency,retention from powa_servers;
id | hostname | alias | port | username | password | dbname | frequency | retention
----+----------------+----------+------+----------+----------+----------+-----------+-----------
0 | | | 0 | | | | -1 | 00:00:00
1 | sl73cawpdbq001 | ADOBE QA | 5432 | postgres | postgres | postgres | 300 | 7 days
(2 rows)
There are no error messages in the powa-web log file.
[I 240320 23:09:02 powa-web:39] Starting powa-web on http://127.0.0.1:8889/
[I 240320 23:09:14 web:1811] 302 GET / (127.0.0.1) 0.89ms
[W 240320 23:09:14 web:1811] 403 GET /login/?next=%2F (127.0.0.1) 13.34ms
[I 240320 23:09:14 web:1811] 200 GET /static/css/powa-all.min.css?v=8c7dc8452e317e10953cf920dd367485 (127.0.0.1) 1.94ms
[I 240320 23:09:15 web:1811] 200 GET /static/css/translucent.css?v=647ebcff5289bfdd1746def10b39f389 (127.0.0.1) 0.72ms
[I 240320 23:09:15 web:1811] 200 GET /static/img/favicon/favicon-32x32.png?v=f64009832088abf024bd5c01c175449f (127.0.0.1) 0.50ms
[I 240320 23:09:15 web:1811] 200 GET /static/js/require.js?v=640929dac3c23a448d2eebc37bc32062 (127.0.0.1) 0.96ms
[I 240320 23:09:15 web:1811] 200 GET /static/js/powa.min-all.js?v=9b661ca18f5af5c8c6c0b15e6150f5e1 (127.0.0.1) 1.59ms
[I 240320 23:09:25 web:1811] 302 POST /login/?next=%2F (127.0.0.1) 1588.27ms
[I 240320 23:09:25 web:1811] 302 GET / (127.0.0.1) 170.11ms
[I 240320 23:09:26 web:1811] 200 GET /server/ (127.0.0.1) 182.50ms
[I 240320 23:09:26 web:1811] 200 GET /static/css/foundation-icons.woff (127.0.0.1) 0.97ms
is there any error in the browser console?
No errors in the browser console.
any error in the underlying postgres repository server?
It was not showing errors when only one server sl73cawpdbq001 was registered earlier. When I registered the second server, and restarted collector, it started showing errors.
2024-03-20 23:18:50,696 - INFO : List of workers:
2024-03-20 23:18:50,697 - INFO : sl73cawpdbq001:5432: {'host': 'sl73cawpdbq001', 'port': 5432, 'user': 'postgres', 'dbname': 'postgres'} (no connection to remote server)
2024-03-20 23:18:50,697 - INFO : sl73togadbq003:5432: {'host': 'sl73togadbq003', 'port': 5432, 'user': 'postgres', 'dbname': 'postgres'} (no connection to remote server)
2024-03-20 23:18:50,723 sl73togadbq003:5432 ERROR : PoWA extension not found
2024-03-20 23:18:50,723 sl73togadbq003:5432 INFO : Disconnecting from remote server
2024-03-20 23:18:50,723 sl73togadbq003:5432 INFO : Disconnecting from repository
Exception in thread sl73togadbq003:5432:
Traceback (most recent call last):
File "/usr/lib64/python3.6/threading.py", line 937, in _bootstrap_inner
self.run()
File "/pgbin/powa/powa-collector-1.1.1/powa_collector/powa_worker.py", line 597, in run
self.__worker_main()
File "/pgbin/powa/powa-collector-1.1.1/powa_collector/powa_worker.py", line 340, in __worker_main
self.__check_powa()
File "/pgbin/powa/powa-collector-1.1.1/powa_collector/powa_worker.py", line 200, in __check_powa
self.__connect()
File "/pgbin/powa/powa-collector-1.1.1/powa_collector/powa_worker.py", line 296, in __connect
cur = self.__remote_conn.cursor()
AttributeError: 'NoneType' object has no attribute 'cursor'
2024-03-20 23:18:54,518 - INFO : Stopping all workers and exiting...
2024-03-20 23:18:54,518 sl73cawpdbq001:5432 INFO : Asked to stop...
2024-03-20 23:18:54,518 sl73togadbq003:5432 INFO : Asked to stop...
2024-03-20 23:18:54,649 sl73cawpdbq001:5432 INFO : Disconnecting from remote server
2024-03-20 23:18:54,649 sl73cawpdbq001:5432 INFO : stopped
2024-03-20 23:19:01,321 - INFO : Starting powa-collector...
2024-03-20 23:19:01,330 sl73cawpdbq001:5432 INFO : Starting worker
2024-03-20 23:19:01,330 sl73togadbq003:5432 INFO : Starting worker
2024-03-20 23:19:01,330 - INFO : List of workers:
2024-03-20 23:19:01,332 - INFO : sl73cawpdbq001:5432: {'host': 'sl73cawpdbq001', 'port': 5432, 'user': 'postgres', 'dbname': 'postgres'} (no connection to remote server)
2024-03-20 23:19:01,332 - INFO : sl73togadbq003:5432: {'host': 'sl73togadbq003', 'port': 5432, 'user': 'postgres', 'dbname': 'postgres'} (no connection to remote server)
2024-03-20 23:19:01,390 sl73togadbq003:5432 ERROR : PoWA extension not found
2024-03-20 23:19:01,391 sl73togadbq003:5432 INFO : Disconnecting from remote server
2024-03-20 23:19:01,391 sl73togadbq003:5432 INFO : Disconnecting from repository
Well, you clearly missed some configuration steps.
Is everything now working after fixing that error?
Yes, everything looks good now. There was some issue with the http server. I reinstalled which fixed the issue.
Btw. I have got another question related to startup of collector and web.
I usually start both the daemons using nohup ./powa-collector.py & and nohup ./powa-web & from its respective directories.
I have seen nohup.out grown big, especially for powa-web. Any click on the Web UI writes to this log file.
Is there any better mechanism to log these two daemon processes, and if possible perform log purging?
Thanks
Hari
ah good news!
for the logs if you're relying on custom startup the usual answer is to configure some external log file utility for behaviour you want, like logrotate (assuming that nohup plays well with it)
otherwise nowadays this is supposed to be handled by the OS service infrastructure, like systemd and journald
Ok thanks. Will check those options.