ERROR: Spine Timed Out While Waiting for Threads to End

Post general support questions here that do not specifically fall into the Linux or Windows categories.

Moderators: Moderators, Developers

Post Reply
Author
Message
velbon17006
Posts: 15
Joined: Mon Jun 12, 2017 6:38 am

ERROR: Spine Timed Out While Waiting for Threads to End

#1 Post by velbon17006 » Sun Sep 08, 2019 6:50 am

2019/09/08 11:42:02 - SYSTEM MONITOR STATS: Time:0.3 Reboots:0 DownDevices:0 Notifications:0 Purges:0
2019/09/08 11:42:01 - SPINE: Poller[Main Poller] ERROR: Spine Timed Out While Waiting for Threads to End
2019/09/08 11:42:01 - POLLER: Poller[Main Poller] WARNING: There are '1' detected as overrunning a polling process, please investigate
2019/09/08 11:42:01 - SYSTEM THOLD DAEMON STATS: TotalTime:0.000 MaxRuntime:0.000 Processed:0 InProcess:0 TotalDevices:431 DownDevices:56 NewDownDevices:0 MaxProcesses:10 Completed:0 Running:0 Broken:0
2019/09/08 11:42:00 - SPINE: Poller[Main Poller] ERROR: Spine Timed Out While Processing Devices Internal
2019/09/08 11:42:00 - SYSTEM STATS: Time:58.3802 Method:spine Processes:1 Threads:1 Hosts:431 HostsPerProcess:431 DataSources:297 RRDsProcessed:1
2019/09/08 11:42:00 - POLLER: Poller[Main Poller] Maximum runtime of 58 seconds exceeded. Exiting.
2019/09/08 11:41:03 - SYSTEM MONITOR STATS: Time:0.24 Reboots:0 DownDevices:0 Notifications:0 Purges:0
2019/09/08 11:41:03 - SYSTEM THOLD DAEMON STATS: TotalTime:0.000 MaxRuntime:0.000 Processed:0 InProcess:0 TotalDevices:431 DownDevices:56 NewDownDevices:0 MaxProcesses:10 Completed:0 Running:0 Broken:0

cigamit
Developer
Posts: 2784
Joined: Thu Apr 07, 2005 3:29 pm
Location: B/CS Texas
Contact:

Re: ERROR: Spine Timed Out While Waiting for Threads to End

#2 Post by cigamit » Sun Sep 08, 2019 9:27 am

Processes:1 Threads:1
In Settings, Increase the number of Threads (to ~12) and the number of Processes to be equal the number of CPU Cores.

velbon17006
Posts: 15
Joined: Mon Jun 12, 2017 6:38 am

Re: ERROR: Spine Timed Out While Waiting for Threads to End

#3 Post by velbon17006 » Sun Sep 08, 2019 10:35 pm

Dear Cigamit,
I had already increased the threads to 4 and the process to 4 (well it is not important bacause i am using spine poller) though my CPU core is 1 but i am still receiving some amount of errors such as:

2019/09/09 03:42:01 - SPINE: Poller[Main Poller] ERROR: Spine Timed Out While Waiting for Threads to End
2019/09/09 03:42:01 - POLLER: Poller[Main Poller] WARNING: There are '1' detected as overrunning a polling process, please investigate
2019/09/09 03:42:00 - SPINE: Poller[Main Poller] ERROR: Spine Timed Out While Processing Devices Internal
2019/09/09 03:42:00 - SYSTEM STATS: Time:58.3802 Method:spine Processes:1 Threads:1 Hosts:431 HostsPerProcess:431 DataSources:297 RRDsProcessed:1
2019/09/09 03:42:00 - POLLER: Poller[Main Poller] Maximum runtime of 58 seconds exceeded. Exiting.

cigamit
Developer
Posts: 2784
Joined: Thu Apr 07, 2005 3:29 pm
Location: B/CS Texas
Contact:

Re: ERROR: Spine Timed Out While Waiting for Threads to End

#4 Post by cigamit » Sun Sep 08, 2019 10:56 pm

Change it on the "Main Poller" under "Data Collections" on the Console menu, the setting there is overriding the normal setting.

velbon17006
Posts: 15
Joined: Mon Jun 12, 2017 6:38 am

Re: ERROR: Spine Timed Out While Waiting for Threads to End

#5 Post by velbon17006 » Sun Sep 08, 2019 11:18 pm

Dear Cigamit,
I had already increased the threads to 8 and it had stopped sending those errors. Thanks very much for your help. I will keep monitoring it now.

Post Reply