totalling 22 Data Sources. Please Either Re-Index, Delete or[solved]

Post support questions that directly relate to Linux/Unix operating systems.

Moderators: Moderators, Developers

Author
Message
majed17
Cacti User
Posts: 58
Joined: Thu Jul 17, 2014 10:24 pm

totalling 22 Data Sources. Please Either Re-Index, Delete or[solved]

#1 Post by majed17 » Fri Aug 02, 2019 6:05 am

Peace, it has been a while since i added a host to cacti, so when i did on version 1.2.5, it started nagging that:
totalling 22 Data Sources. Please Either Re-Index, Delete or Disable these Data Sources
so i went to console, management and data sources and selected bad indexes and went to graph management and deleted the offending graphs, but then i discovered that the new host replaced the graphs of another host, so i tried recreating the graphs for the other host but then it happened to a third host. i tried running the reindex poller but that didn't help. Also i noticed that the log files are 3 hours behind, so i restarted apache and cron and the log time went correct for less than 5 minutes and then lagged back to 3 hours, although the time in graphing is correct, the date on linux is correct. what to do?
this is what happened when i reindexed,

Code: Select all

CMDPHP PHP ERROR WARNING Backtrace: (/cli/poller_reindex_hosts.php[141]:run_data_query(), /lib/data_query.php[106]:query_snmp_host(), /lib/data_query.php[727]:get_best_data_query_index_type(), /lib/data_query.php[2029]:sizeof(), CactiErrorHandler()
Last edited by majed17 on Thu Aug 29, 2019 12:47 am, edited 1 time in total.
knock and it shall be opened, ask and you shall receive, believe in order for it to happen, cry and you shall be comforted!

User avatar
Osiris
Cacti Pro User
Posts: 863
Joined: Mon Jan 05, 2015 10:10 am

Re: totalling 22 Data Sources. Please Either Re-Index, Delet

#2 Post by Osiris » Fri Aug 02, 2019 5:07 pm

Update to develop, and then re-index again. Some of these may be real. After re-index, go-to data sources and select orphans to get more info on the data sources.
Before history, there was a paradise, now dust.

majed17
Cacti User
Posts: 58
Joined: Thu Jul 17, 2014 10:24 pm

Re: totalling 22 Data Sources. Please Either Re-Index, Delet

#3 Post by majed17 » Mon Aug 05, 2019 2:24 am

i installed cacti develop and spine develop, and it didn't present an upgrade script, just stayed 1.2.5.
reindexing showed the following error

Code: Select all

..PHP Notice:  Undefined index: fields in /var/www/localhost/htdocs/cacti/lib/data_query.php on line 2029
PHP Warning:  sizeof(): Parameter must be an array or an object that implements Countable in /var/www/localhost/htdocs/cacti/lib/data_query.php on line 202
knock and it shall be opened, ask and you shall receive, believe in order for it to happen, cry and you shall be comforted!

majed17
Cacti User
Posts: 58
Joined: Thu Jul 17, 2014 10:24 pm

Re: totalling 22 Data Sources. Please Either Re-Index, Delet

#4 Post by majed17 » Thu Aug 08, 2019 3:52 am

so nothing else can be done? the log date error was because the apache-cli php.ini file didn't have the time.zone defined in it
knock and it shall be opened, ask and you shall receive, believe in order for it to happen, cry and you shall be comforted!

User avatar
Osiris
Cacti Pro User
Posts: 863
Joined: Mon Jan 05, 2015 10:10 am

Re: totalling 22 Data Sources. Please Either Re-Index, Delet

#5 Post by Osiris » Sun Aug 11, 2019 9:30 pm

I think that last issue has just been fixed.
Before history, there was a paradise, now dust.

majed17
Cacti User
Posts: 58
Joined: Thu Jul 17, 2014 10:24 pm

Re: totalling 22 Data Sources. Please Either Re-Index, Delet

#6 Post by majed17 » Mon Aug 12, 2019 9:00 am

it is on github, and i tried the fix unsuccessfully..
knock and it shall be opened, ask and you shall receive, believe in order for it to happen, cry and you shall be comforted!

User avatar
Osiris
Cacti Pro User
Posts: 863
Joined: Mon Jan 05, 2015 10:10 am

Re: totalling 22 Data Sources. Please Either Re-Index, Delete or

#7 Post by Osiris » Mon Aug 12, 2019 5:28 pm

You have to grab from branch 1.2.x and not develop.
Before history, there was a paradise, now dust.

majed17
Cacti User
Posts: 58
Joined: Thu Jul 17, 2014 10:24 pm

Re: totalling 22 Data Sources. Please Either Re-Index, Delete or

#8 Post by majed17 » Tue Aug 13, 2019 6:13 am

so i've been advised but i couldn't find it, sorry
knock and it shall be opened, ask and you shall receive, believe in order for it to happen, cry and you shall be comforted!


majed17
Cacti User
Posts: 58
Joined: Thu Jul 17, 2014 10:24 pm

Re: totalling 22 Data Sources. Please Either Re-Index, Delete or

#10 Post by majed17 » Wed Aug 14, 2019 1:40 am

so after battling with missing xml file for router memory, i finally managed to reindex the indexes and the ones that were causing the problems are gone, but now it is not graphing, even though i restarted mysql, apache2, vixie-cron, several times, must be because i'm on cacti 1.2.6 and spine 1.2.5, the log shows:

Code: Select all

2019/08/14 09:35:00 - POLLER: Poller[Main Poller] Maximum runtime of 298 seconds exceeded. Exiting. 
knock and it shall be opened, ask and you shall receive, believe in order for it to happen, cry and you shall be comforted!

netniV
Cacti Guru User
Posts: 2930
Joined: Sun Aug 27, 2017 12:05 am

Re: totalling 22 Data Sources. Please Either Re-Index, Delete or

#11 Post by netniV » Wed Aug 14, 2019 3:01 am

Up your debugging level so you can see what is being polled and how long things are taking. The chances are you have a timeout issue occurring with a high timeout value resulting in the overrun. For example, if you have 1 minute polling, but set the timeout on everything to 5 seconds, that 5 seconds, then any device outage could wait hit that timeout one or more times (especially if you have uptime set as ping or snmp).

majed17
Cacti User
Posts: 58
Joined: Thu Jul 17, 2014 10:24 pm

Re: totalling 22 Data Sources. Please Either Re-Index, Delete or

#12 Post by majed17 » Wed Aug 14, 2019 4:27 am

and how to do that?
i enabled devel developer debugging and in the poller detailed.. but it is still only produces 3 lines like before, must i restart something?
knock and it shall be opened, ask and you shall receive, believe in order for it to happen, cry and you shall be comforted!

majed17
Cacti User
Posts: 58
Joined: Thu Jul 17, 2014 10:24 pm

Re: totalling 22 Data Sources. Please Either Re-Index, Delete or

#13 Post by majed17 » Wed Aug 14, 2019 6:27 am

i canged to medium and this what i get :

Code: Select all

POLLER: Poller[Main Poller] NOTE: Poller Int: '300', Cron Int: '300', Time Since Last: '300.72', Max Runtime '298', Poller Runs: '1' 
knock and it shall be opened, ask and you shall receive, believe in order for it to happen, cry and you shall be comforted!

netniV
Cacti Guru User
Posts: 2930
Joined: Sun Aug 27, 2017 12:05 am

Re: totalling 22 Data Sources. Please Either Re-Index, Delete or

#14 Post by netniV » Wed Aug 14, 2019 7:36 am

No, you just want the standard logging level increased, not the developer debug one as that's more for looking into MySQL issues.

You may need to increase it again from Medium but I would have thought you would have seen at least something more.

majed17
Cacti User
Posts: 58
Joined: Thu Jul 17, 2014 10:24 pm

Re: totalling 22 Data Sources. Please Either Re-Index, Delete or

#15 Post by majed17 » Wed Aug 14, 2019 7:43 am

i have poller interval 5 min, cron 5 min, poller sync 2hours., i increased the timeout to 20secs and still no graphing..
here is the log:

Code: Select all

2019/08/14 15:40:12 - WEBUI Found Valid 'Graph Template' priming cache
2019/08/14 15:40:12 - WEBUI Fetch InitRows:-1, Hash:1597d7f033a83a19f5b1a2356ce08ea0
2019/08/14 15:40:12 - WEBUI Obtaining 'Graph Template' cache
2019/08/14 15:40:01 - POLLER: Poller[Main Poller] NOTE: Poller Int: '300', Cron Int: '300', Time Since Last: '300.61', Max Runtime '298', Poller Runs: '1'
2019/08/14 15:40:00 - REPORTS Cacti Reports reports found: 0
2019/08/14 15:40:00 - SYSTEM STATS: Time:298.6046 Method:spine Processes:1 Threads:1 Hosts:37 HostsPerProcess:37 DataSources:4456 RRDsProcessed:0
2019/08/14 15:40:00 - SYSTEM WARNING: Primary Admin account notifications disabled! Unable to send administrative Email.
2019/08/14 15:40:00 - POLLER: Poller[Main Poller] Maximum runtime of 298 seconds exceeded. Exiting. 
knock and it shall be opened, ask and you shall receive, believe in order for it to happen, cry and you shall be comforted!

Post Reply