tenstorrent/tt-inference-server

Capture tt-metal and tt-NN loguru logs in inference server python log files

Opened this issue · 0 comments

Currently only the logs from inference server are stored in the log files and logs from tt-metal and model implementations in tt-NN which are imported libraries are only shown in std out and not logged to file.

For example the device opening logs:

                 Device | INFO     | Opening user mode device driver                                                                                                                                                                                        
  Detecting chips (found 8)                                                                                                                                                                                                                                 
2024-09-24 15:21:35.078 | INFO     | SiliconDriver   - Detected 4 PCI devices : [0, 1, 2, 3]                                                                                                                                                                
2024-09-24 15:21:35.133 | INFO     | SiliconDriver   - Software version 6.0.0, Ethernet FW version 6.9.0 (Device 0)                                                                                                                                         
2024-09-24 15:21:35.133 | INFO     | SiliconDriver   - Software version 6.0.0, Ethernet FW version 6.9.0 (Device 4)                                                                                                                                         
2024-09-24 15:21:35.136 | INFO     | SiliconDriver   - Detected 4 PCI devices : [0, 1, 2, 3]                                                                                                                                                                
2024-09-24 15:21:35.150 | INFO     | SiliconDriver   - Software version 6.0.0, Ethernet FW version 6.9.0 (Device 1)                                                                                                                                         
2024-09-24 15:21:35.150 | INFO     | SiliconDriver   - Software version 6.0.0, Ethernet FW version 6.9.0 (Device 5)                                                                                                                                         
2024-09-24 15:21:35.154 | INFO     | SiliconDriver   - Detected 4 PCI devices : [0, 1, 2, 3]                                                                                                                                                                
2024-09-24 15:21:35.169 | INFO     | SiliconDriver   - Software version 6.0.0, Ethernet FW version 6.9.0 (Device 2)                                                                                                                                         
2024-09-24 15:21:35.169 | INFO     | SiliconDriver   - Software version 6.0.0, Ethernet FW version 6.9.0 (Device 6)                                                                                                                                         
2024-09-24 15:21:35.171 | INFO     | SiliconDriver   - Detected 4 PCI devices : [0, 1, 2, 3]                                                                                                                                                                
2024-09-24 15:21:35.185 | INFO     | SiliconDriver   - Software version 6.0.0, Ethernet FW version 6.9.0 (Device 3)                                                                                                                                         
2024-09-24 15:21:35.186 | INFO     | SiliconDriver   - Software version 6.0.0, Ethernet FW version 6.9.0 (Device 7)                                                                                                                                         
                  Metal | INFO     | Initializing device 0. Program cache is NOT enabled                                      
                  Metal | INFO     | AI CLK for device 0 is:   900 MHz                                                        
                  Metal | INFO     | Initializing device 4. Program cache is NOT enabled                                      
                  Metal | INFO     | AI CLK for device 4 is:   900 MHz                                                        
                  Metal | INFO     | Initializing device 3. Program cache is NOT enabled                                      
                  Metal | INFO     | AI CLK for device 3 is:   900 MHz                                                        
                  Metal | INFO     | Initializing device 7. Program cache is NOT enabled                                      
                  Metal | INFO     | AI CLK for device 7 is:   900 MHz                                                        
                  Metal | INFO     | Initializing device 2. Program cache is NOT enabled                                      
                  Metal | INFO     | AI CLK for device 2 is:   900 MHz                                                        
                  Metal | INFO     | Initializing device 6. Program cache is NOT enabled                                      
                  Metal | INFO     | AI CLK for device 6 is:   900 MHz                                                        
                  Metal | INFO     | Initializing device 1. Program cache is NOT enabled                                      
                  Metal | INFO     | AI CLK for device 1 is:   900 MHz                                                        
                  Metal | INFO     | Initializing device 5. Program cache is NOT enabled                                      
                  Metal | INFO     | AI CLK for device 5 is:   900 MHz                                                        
                  Metal | INFO     | MMIO Device 0 : Tunnel 0 : Device 0                                                      
                  Metal | INFO     | MMIO Device 0 : Tunnel 0 : Device 4                                                      
                  Metal | INFO     | MMIO Device 1 : Tunnel 0 : Device 1                                                      
                  Metal | INFO     | MMIO Device 1 : Tunnel 0 : Device 5                                                      
                  Metal | INFO     | MMIO Device 2 : Tunnel 0 : Device 2                                                      
                  Metal | INFO     | MMIO Device 2 : Tunnel 0 : Device 6                                                      
                  Metal | INFO     | MMIO Device 3 : Tunnel 0 : Device 3                                                      
                  Metal | INFO     | MMIO Device 3 : Tunnel 0 : Device 7