ateodorescu/home-assistant-addons

Php Process Error on latest version

fmarcoux96 opened this issue · 30 comments

Currently having an issue where none of my servers are loading properly. Did the updates to the addon and the HACS integration and it doesn't work.

2024/03/14 07:20:18 [error] 205#205: *1 FastCGI sent in stderr: "PHP message: [critical] Uncaught PHP Exception Symfony\Component\Process\Exception\ProcessSignaledException: "The process has been signaled with signal "11"." at /app/vendor/symfony/process/Process.php line 436" while reading response header from upstream, client: 172.30.32.1, server: _, request: "GET /?host=192.168.1.21&port=623&user=root&password=calvin HTTP/1.1", upstream: "fastcgi://127.0.0.1:9000", host: "localhost:9595"

trying to monitor Dell iDRAC.

What do you get when you run the following command?
ipmitool -H YOUR_SERVER -p 623 -U root -P calvin -I lanplus sensor

same here. Thanks for the #9 (comment) fix, but now I get this error.

2024/03/14 22:52:16 [error] 205#205: *3 FastCGI sent in stderr: "PHP message: Error occurred when running "ipmitool -H 192.168.2.2 -p 623 -U root -P #### -I lanplus dcmi power reading".

grafik

on the console:
ipmitool -I lanplus -H 192.168.2.2 -U root -P $pfpw sensor

grafik

If I try the same command as mentioned in the logs:
grafik

IPMI Tools Server Addon: 1.2.0
HA Connector: 1.5.0
Server: Dell PowerEdge R210 II
iDRAC6 IPMI-Version 2.0

Seeing similar behavior with Dell PowerEdge R630

2024/03/14 22:20:45 [error] 206#206: *107 FastCGI sent in stderr: "PHP message: [critical] Uncaught PHP Exception Symfony\Component\Process\Exception\ProcessSignaledException: "The process has been signaled with signal "11"." at /app/vendor/symfony/process/Process.php line 436" while reading response header from upstream, client: 172.30.32.1, server: _, request: "GET /?host=10.10.20.11&port=623&user=root&password=#####&interface=lanplus HTTP/1.1", upstream: "fastcgi://127.0.0.1:9000", host: "localhost:9595"`

IMPI Tool Addon: v1.2.0
HA IPMI Integration: v1.5.0 (also has connection issues w/v1.4.0)
Server: Dell PowerEdge R630
iDrac v8 FW: 2.85.85.85
IPMI Version: 2.0

When running the command from within the IPMI-Server container, I get the following:

root@304fecf0-ipmi-server:/$ ipmitool -H 10.10.20.11 -p 623 -U root -P ##### -I lanplus sdr elist
SEL              | 72h | ns  |  7.1 | No Reading
Intrusion        | 73h | ok  |  7.1 | 
Fan1A            | 30h | ok  |  7.1 | 5160 RPM
Fan2A            | 32h | ok  |  7.1 | 5040 RPM
Fan3A            | 34h | ok  |  7.1 | 5040 RPM
Fan4A            | 36h | ok  |  7.1 | 5040 RPM
Fan5A            | 38h | ok  |  7.1 | 5040 RPM
Fan6A            | 3Ah | ok  |  7.1 | 5160 RPM
Inlet Temp       | 04h | ok  |  7.1 | 22 degrees C
CPU Usage        | FDh | ok  |  7.1 | 0 percent
IO Usage         | F1h | ok  |  7.1 | 0 percent
MEM Usage        | F2h | ok  |  7.1 | 0 percent
SYS Usage        | F3h | ok  |  7.1 | 0 percent
Exhaust Temp     | 01h | ok  |  7.1 | 32 degrees C
Temp             | 0Eh | ok  |  3.1 | 38 degrees C
Temp             | 0Fh | ok  |  3.2 | 37 degrees C
OS Watchdog      | 71h | ok  |  7.1 | 
VCORE PG         | 23h | ok  |  3.1 | State Deasserted
VCORE PG         | 24h | ok  |  3.2 | State Deasserted
3.3V PG          | 19h | ok  |  7.1 | State Deasserted
5V AUX PG        | 1Ah | ok  |  7.1 | State Deasserted
USB Cable Pres   | 50h | ok  |  7.1 | Connected
VGA Cable Pres   | 51h | ok  |  7.1 | Connected
Dedicated NIC    | 70h | ok  |  7.1 | Present
Presence         | 49h | ok  | 11.2 | Present
Presence         | 40h | ok  |  3.1 | Present
Presence         | 41h | ok  |  3.2 | Present
M23 VPP PG       | 22h | ok  |  3.2 | State Deasserted
M23 VPP PG       | 25h | ok  |  3.1 | State Deasserted
2.5V AUX PG      | 26h | ok  |  7.1 | State Deasserted
1.05V PG         | 27h | ok  |  7.1 | State Deasserted
M23 VDDQ PG      | 15h | ok  |  3.1 | State Deasserted
M23 VTT PG       | 16h | ok  |  3.1 | State Deasserted
5V SWITCH PG     | 21h | ok  |  7.1 | State Deasserted
Presence         | 43h | ok  | 10.2 | Present
DIMM PG          | 29h | ok  |  7.1 | State Deasserted
VCCIO PG         | 2Bh | ok  |  7.1 | State Deasserted
M01 VDDQ PG      | 1Bh | ok  |  3.2 | State Deasserted
M01 VDDQ PG      | 1Eh | ok  |  3.1 | State Deasserted
M23 VTT PG       | 2Eh | ok  |  3.2 | State Deasserted
M01 VTT PG       | 1Ch | ok  |  3.2 | State Deasserted
NDC PG           | 2Fh | ok  |  7.1 | State Deasserted
LCD Cable Pres   | 4Ch | ok  |  7.1 | Connected
M01 VPP PG       | 1Fh | ok  |  3.2 | State Deasserted
M01 VPP PG       | 20h | ok  |  3.1 | State Deasserted
M23 VDDQ PG      | 1Dh | ok  |  3.2 | State Deasserted
Presence         | 4Ah | ok  | 11.1 | Present
Presence         | 48h | ok  | 11.3 | Present
Status           | 60h | ok  |  3.1 | Presence detected
Status           | 61h | ok  |  3.2 | Presence detected
Fan Redundancy   | 75h | ok  |  7.1 | Fully Redundant
Riser Config Err | 64h | ok  |  7.1 | Connected
Riser 3 Presence | 4Fh | ok  |  7.1 | Connected
1.5V PG          | 28h | ok  |  7.1 | State Deasserted
1.5V AUX PG      | F9h | ok  |  7.1 | State Deasserted
FIVR PG          | FBh | ok  |  3.1 | State Deasserted
FIVR PG          | FCh | ok  |  3.2 | State Deasserted
PS2 PG Fail      | 2Ch | ok  |  7.1 | State Deasserted
PS1 PG Fail      | 2Dh | ok  |  7.1 | State Deasserted
BP0 5V PG        | F6h | ns  |  7.1 | Disabled
BP1 5V PG        | F7h | ok  |  7.1 | State Deasserted
BP2 5V PG        | F8h | ok  |  7.1 | State Deasserted
M01 VTT PG       | 14h | ok  |  3.1 | State Deasserted
Presence         | 42h | ok  | 10.1 | Present
PCIe Slot1       | 90h | ok  |  7.1 | 
PCIe Slot2       | 91h | ns  |  7.1 | Disabled
PCIe Slot3       | 92h | ns  |  7.1 | Disabled
PCIe Slot4       | 93h | ns  |  7.1 | Disabled
PCIe Slot5       | 94h | ns  |  7.1 | Disabled
PCIe Slot6       | 95h | ns  |  7.1 | Disabled
PCIe Slot7       | 96h | ns  |  7.1 | Disabled
vFlash           | FAh | ok  | 12.1 | 
CMOS Battery     | 65h | ok  |  7.1 | 
ROMB Battery     | 68h | ok  | 11.2 | 
ROMB Battery     | 69h | ns  | 11.4 | Disabled
BP1 Presence     | 54h | ok  | 26.1 | Absent
BP2 Presence     | 55h | ok  | 26.2 | Present
Fan7A            | 3Ch | ok  |  7.1 | 5160 RPM
Fan1B            | 31h | ok  |  7.1 | 4800 RPM
Fan2B            | 33h | ok  |  7.1 | 4800 RPM
Fan3B            | 35h | ok  |  7.1 | 4800 RPM
Fan4B            | 37h | ok  |  7.1 | 4680 RPM
Fan5B            | 39h | ok  |  7.1 | 4800 RPM
Fan6B            | 3Bh | ok  |  7.1 | 4800 RPM
Fan7B            | 3Dh | ok  |  7.1 | 4680 RPM
Current 1        | 6Ah | ok  | 10.1 | 0.40 Amps
Current 2        | 6Bh | ok  | 10.2 | 0.60 Amps
Voltage 1        | 6Ch | ok  | 10.1 | 118 Volts
Voltage 2        | 6Dh | ok  | 10.2 | 118 Volts
PS Redundancy    | 74h | ns  |  7.1 | No Reading
Status           | 62h | ok  | 10.1 | Presence detected
Status           | 63h | ok  | 10.2 | Presence detected
Pwr Consumption  | 77h | ok  |  7.1 | 112 Watts
Power Optimized  | 76h | ok  |  7.1 | 
SD1              | F4h | ok  | 11.3 | 
SD2              | F5h | ok  | 11.3 | 
Redundancy       | 78h | ok  | 11.3 | Fully Redundant
ECC Corr Err     | 01h | ns  | 34.1 | No Reading
ECC Uncorr Err   | 02h | ns  | 34.1 | No Reading
I/O Channel Chk  | 03h | ns  | 34.1 | No Reading
PCI Parity Err   | 04h | ns  | 34.1 | No Reading
PCI System Err   | 05h | ns  | 34.1 | No Reading
SBE Log Disabled | 06h | ns  | 34.1 | No Reading
Logging Disabled | 07h | ns  | 34.1 | No Reading
Unknown          | 08h | ns  | 34.1 | No Reading
CPU Protocol Err | 0Ah | ns  | 34.1 | No Reading
CPU Bus PERR     | 0Bh | ns  | 34.1 | No Reading
CPU Init Err     | 0Ch | ns  | 34.1 | No Reading
CPU Machine Chk  | 0Dh | ns  | 34.1 | No Reading
Memory Spared    | 11h | ns  | 34.1 | No Reading
Memory Mirrored  | 12h | ns  | 34.1 | No Reading
Memory RAID      | 13h | ns  | 34.1 | No Reading
Memory Added     | 14h | ns  | 34.1 | No Reading
Memory Removed   | 15h | ns  | 34.1 | No Reading
Memory Cfg Err   | 16h | ns  | 34.1 | No Reading
Mem Redun Gain   | 17h | ns  | 34.1 | No Reading
PCIE Fatal Err   | 18h | ns  | 34.1 | No Reading
Additional Info  | 2Eh | ns  | 34.1 | No Reading
Mem ECC Warning  | 1Bh | ns  | 34.1 | No Reading
Mem CRC Err      | 1Ch | ns  | 34.1 | No Reading
USB Over-current | 1Dh | ns  | 34.1 | No Reading
POST Err         | 1Eh | ns  | 34.1 | No Reading
Mem Overtemp     | 20h | ns  | 34.1 | No Reading
iDPT Memfail     | 2Bh | ns  | 34.1 | No Reading
Mem Fatal SB CRC | 21h | ns  | 34.1 | No Reading
Mem Fatal NB CRC | 22h | ns  | 34.1 | No Reading
OS Watchdog Time | 71h | ns  | 34.1 | No Reading
Non Fatal PCI Er | 26h | ns  | 34.1 | No Reading
Interconnect Err | 2Ch | ns  | 34.1 | No Reading
CPU TDP          | 2Fh | ns  | 34.1 | No Reading
CPUMachineCheck  | 3Ch | ns  | 34.1 | No Reading
NonFatalSSDError | 3Bh | ns  | 34.1 | No Reading
NonFatalPCIExpEr | 40h | ns  | 34.1 | No Reading
Fatal IO Error   | 27h | ns  | 34.1 | No Reading
Interconnect Err | 2Dh | ns  | 34.1 | No Reading
Link Error       | 34h | ns  | 34.1 | No Reading
FatalPCIExpEr    | 3Fh | ns  | 34.1 | No Reading
MRC Warning      | 35h | ns  | 34.1 | No Reading
MRC Warning      | 36h | ns  | 34.1 | No Reading
MSR Info Log     | 28h | ns  | 34.1 | No Reading
TXT Status       | 2Ah | ns  | 34.1 | No Reading
Drive 0          | A0h | ok  |  7.1 | Drive Present
Drive 15         | AFh | ns  |  7.1 | Disabled
Cable SAS A0     | E4h | ok  | 26.2 | Connected
Cable PCIe B     | E1h | ns  | 26.2 | Disabled
Cable PCIe C     | E2h | ns  | 26.2 | Disabled
Cable PCIe D     | E3h | ns  | 26.2 | Disabled
Cable PCIe A     | E0h | ns  | 26.2 | Disabled
Cable SAS B0     | E5h | ok  | 26.2 | Connected
Cable SAS A1     | E6h | ns  | 26.2 | No Reading
Cable SAS B1     | E7h | ns  | 26.2 | No Reading
Cable SAS A2     | E8h | ns  | 26.2 | No Reading
Cable SAS B2     | E9h | ns  | 26.2 | No Reading
Power Cable      | 58h | ns  | 26.1 | Disabled
Signal Cable     | 59h | ns  | 26.1 | Disabled
Power Cable      | 5Ah | ok  | 26.2 | Connected
Signal Cable     | 5Bh | ok  | 26.2 | Connected
PFault Fail Safe | 66h | ns  |  7.1 | No Reading
A                | C0h | ok  | 32.1 | Presence Detected
Link Warning     | 33h | ns  | 34.1 | No Reading
NonFatalPCIErBus | 39h | ns  | 34.1 | No Reading
Link Warning     | 32h | ns  | 34.1 | No Reading
Chipset Err      | 19h | ns  | 34.1 | No Reading
Err Reg Pointer  | 1Ah | ns  | 34.1 | No Reading
QPIRC Warning    | 30h | ns  | 34.1 | No Reading
QPIRC Warning    | 31h | ns  | 34.1 | No Reading
Hdwr version err | 1Fh | ns  | 34.1 | No Reading
Chassis Mismatch | 37h | ns  | 34.1 | No Reading
B                | CCh | ok  | 32.1 | Presence Detected
FatalPCIErrOnBus | 38h | ns  | 34.1 | No Reading
Fatal PCI SSD Er | 3Ah | ns  | 34.1 | No Reading
**Segmentation fault (core dumped)**

FYI - running IPMI Tool (v1.8.19 via brew) on Mac works properly.
ipmitool -H 10.10.20.11 -p 623 -U root -P ### -I lanplus sdr elist

I guess Dell servers do not support this command ipmitool -I lanplus -H SERVER_IP -U USER -P PASSWORD dcmi power reading. Maybe this command should run in a try/catch block and ignore it if it fails. On my microserver that command does not fail.

I guess Dell servers do not support this command ipmitool -I lanplus -H SERVER_IP -U USER -P PASSWORD dcmi power reading. Maybe this command should run in a try/catch block and ignore it if it fails. On my microserver that command does not fail.

I can confirm, this command does not exist.
grafik

try/catch is always a good Idea. :)
Hit me, if you need a beta tester.

i have a dell R720 thats supports - ipmitool -I lanplus -H SERVER_IP -U USER -P PASSWORD dcmi power reading and also have a R710 that does not so it depends on the server whether or not it works sdr elist or sensor both work for the R710 i think would a good solution would be not hard coding the commands in addon but lets the user choose which commands work for them

having updated the addon to 1.2.0 i get this error
2024-03-15 14:31:02.592 ERROR (MainThread) [custom_components.ipmi] Unexpected error fetching IPMI coordinator data: 'sensors'
File "/config/custom_components/ipmi/init.py", line 223, in _async_update_data
await self.hass.async_add_executor_job(self.ipmiData.update)
File "/config/custom_components/ipmi/server.py", line 276, in update
2024-03-15 14:31:02.597 DEBUG (MainThread) [custom_components.ipmi] Finished fetching IPMI coordinator data in 7.567 seconds (success: False)
2024-03-15 14:31:22.667 DEBUG (SyncWorker_16) [custom_components.ipmi.server] http://localhost:9595
2024-03-15 14:31:22.667 DEBUG (SyncWorker_16) [custom_components.ipmi.server] {'host': '192.168.1.120', 'port': 623, 'user': 'root', 'password': '###', 'interface': 'lanplus'}

Logger: custom_components.ipmi
Source: helpers/update_coordinator.py:318
integration: IPMI connector (documentation, issues)
First occurred: 14:21:16 (23 occurrences)
Last logged: 14:30:44
Unexpected error fetching IPMI coordinator data: 'sensors'

Traceback (most recent call last):
File "/usr/src/homeassistant/homeassistant/helpers/update_coordinator.py", line 318, in _async_refresh
self.data = await self._async_update_data()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/config/custom_components/ipmi/init.py", line 223, in _async_update_data
await self.hass.async_add_executor_job(self.ipmiData.update)
File "/usr/local/lib/python3.12/concurrent/futures/thread.py", line 58, in run
result = self.fn(*self.args, **self.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/config/custom_components/ipmi/server.py", line 276, in update
info.sensors = json["sensors"]
~~~~^^^^^^^^^^^
KeyError: 'sensors'

@corgan2222 Would you please grab the latest code of the addon and check if it runs on your HASS server? Thanks!

@chunkster29 Would you also please grab the latest code of the addon and try it out? Thanks!

I'm using the lastest code thats whats cousing the error ver 1.1.25 works fine

I'm using the lastest code thats whats cousing the error ver 1.1.25 works fine

I have updated the addon half an hour ago. Would you please grab the latest code (1.2.1) and test it out? Thanks!

I found the ipmi-server in
/usr/share/hassio/addons/git/304fecf0/
and uploaded the whole directory.
cat config.yml shows correct the 1.2.1

grafik

But in the Addons Page and in the logs, Im still on 1.2.0??
grafik

So how to update on a supervised installation?

Screenshot 2024-03-15 at 17 45 03
click on that icon from top right and then it will look like this:
Screenshot 2024-03-15 at 17 47 16

after that you open ipmitool server addon and do the update

Screenshot 2024-03-15 at 17 47 24

Trying to readd the integration with the latest addon and getting the following

Server is dell 720xd

I've redacted username and password.

Hass shows failed to connect.

Tried with IP and localhost for the addon, same result.

2024/03/15 18:08:55 [error] 205#205: *5 FastCGI sent in stderr: "PHP message: [critical] Uncaught PHP Exception Symfony\Component\Process\Exception\ProcessSignaledException: "The process has been signaled with signal "11"." at /app/vendor/symfony/process/Process.php line 436" while reading response header from upstream, client: 10.0.10.10, server: _, request: "GET /?host=192.168.10.10&port=623&user=&password= HTTP/1.1", upstream: "fastcgi://127.0.0.1:9000", host: "10.0.10.10:9595"

Trying to readd the integration with the latest addon and getting the following

Server is dell 720xd

I've redacted username and password.

Hass shows failed to connect.

Tried with IP and localhost for the addon, same result.

2024/03/15 18:08:55 [error] 205#205: *5 FastCGI sent in stderr: "PHP message: [critical] Uncaught PHP Exception Symfony\Component\Process\Exception\ProcessSignaledException: "The process has been signaled with signal "11"." at /app/vendor/symfony/process/Process.php line 436" while reading response header from upstream, client: 10.0.10.10, server: _, request: "GET /?host=192.168.10.10&port=623&user=&password= HTTP/1.1", upstream: "fastcgi://127.0.0.1:9000", host: "10.0.10.10:9595"

addon has version 1.2.1?

Screenshot_20240315_182151_Home Assistant.jpg

Yes, as I said, the latest. I saw your previous comment and updated it, before posting.

Sadly, this didn't work with 1.2.1.

grafik

Then I stopped the add-on, edited the IpmiController.php and rebuild the docker

grafik

I still get a lot of errors, but at least I get data.

grafik
grafik

Thanks, Greetz Stefan

Thanks for the feedback. I have updated the addon again - version 1.2.2. If anyone is interested in testing the latest, I would appreciate it.
Thanks!

Thanks for the feedback. I have updated the addon again - version 1.2.2. If anyone is interested in testing the latest, I would appreciate it.
Thanks!

Just updated, exactly the same error.

Same for me :/
@ateodorescu I write you a PM.

grafik

grafik

grafik

I can confirm it's working on my r710

Just updated -- still seeing 2 issues on v1.2.2 of the add-on.

HW: Home Assistant Blue
Core 2024.3.1
Supervisor 2024.03.0
Operating System 12.1
Frontend 20240307.0

nginx 500 error when trying to open webui during after startup:

2024/03/15 12:13:15 [error] 205#205: *3 FastCGI sent in stderr: "PHP message: [critical] Uncaught PHP Exception TypeError: "Cannot assign null to property App\Controller\IpmiController::$password of type string" at /app/src/Controller/IpmiController.php line 37" while reading response header from upstream, client: 127.0.0.1, server: _, request: "GET / HTTP/1.1", upstream: "fastcgi://127.0.0.1:9000", host: "192.168.0.20:8123"

When manually running ipmi query against server from within the IPMI Server docker container, getting following error.

root@304fecf0-ipmi-server:/$ ipmitool -H 10.10.20.11 -p 623 -U root -P ##### -I lanplus sdr elist
......
Fatal PCI SSD Er | 3Ah | ns  | 34.1 | No Reading
**Segmentation fault (core dumped)**

When I run the same impitool query against my Dell R630 from my Mac cli, 'Fatal PCI SSD Er | 3Ah | ns | 34.1 | No Reading' is the last entity returned in the sdr elist and it returns cleanly to shell.

A new update for the addon is available: 1.2.5
Please try it out and let me know if it works for you!
Thanks!

Screenshot_20240315_193627_Home Assistant.jpg

And same error as before in the addon logs.

A new update for the addon is available: 1.2.5 Please try it out and let me know if it works for you! Thanks!

Different message from add-on launch:

2024/03/15 14:14:32 [error] 205#205: *147 FastCGI sent in stderr: "PHP message: No hostname provided!PHP message: No hostname provided!PHP message: No hostname provided!PHP message: No hostname provided!" while reading response header from upstream, client: 127.0.0.1, server: _, request: "GET / HTTP/1.1", upstream: "fastcgi://127.0.0.1:9000", host: "192.168.0.20:8123"

Still seeing same issues from IPMI Connector v1.2 when trying to do a Dell R630 server add:

2024/03/15 14:18:28 [error] 205#205: *157 FastCGI sent in stderr: "PHP message: Error occurred when running "ipmitool -H 10.10.20.11 -p 623 -U root -P #### -I lanplus sensor".
The process has been signaled with signal "11"" while reading response header from upstream, client: 172.30.32.1, server: _, request: "GET /?host=10.10.20.11&port=623&user=root&password=####&interface=lanplus HTTP/1.1", upstream: "fastcgi://127.0.0.1:9000", host: "localhost:9595"

Seeing same error when trying to perform SDR elist from within the IMPI Server v1.2.5 add-on:

Fatal PCI SSD Er | 3Ah | ns  | 34.1 | No Reading
Segmentation fault (core dumped)
root@304fecf0-ipmi-server:/$ 

Just updated the addon to version 1.2.7. Please test it out. Let's see if the "sdr list full" command works better than "sensor" command. Thanks!

Just updated the addon to version 1.2.7. Please test it out. Let's see if the "sdr list full" command works better than "sensor" command. Thanks!

Screenshot_20240316_105728_Home Assistant.jpg

The latest one, works like a charm. Thank you for your time and effort.

1.27 works perfectly!! Awesome Job Adrian! Thanks a lot!

@MwC-Trexx, @fmarcoux96 Does the latest version of addon 1.2.7 work for you?
Thanks!

@MwC-Trexx, @fmarcoux96 Does the latest version of addon 1.2.7 work for you? Thanks!

Seems like it! Thanks a lot! Sorry haven't been useful, too busy to play around with it recently.