Grafana-zabbix: Exponential lag on auto-updating dashboards
Starting with the 3.x releases of grafana and zabbix-grafana plugin, running zabbix continuously has become impossible for me. Setting up simple charts monitoring a couple interfaces is enough to crash the browser after a few minutes.
The setup is simple. setup a chart watching a couple network interfaces. Set the auto refresh to 1 minute. The first few refreshes are fine, but after 10 minutes things start to slow down. After 15 minutes, the reload time for the page can exceed a full minute. The browser pegs the CPU, and the fan kick in.
I have tested this on safari, chrome, and firefox on both OS X and windows. Same results.
running grafana beta 3, plugin b5, zabbix 3.0.1
New dashboard-1460490084828.txt
mcbeenb
All 17 comments
I'll try to reproduce this bug, but would be great if you provide some info like performance profiling results from browser.
alexanderzobnin
on 13 Apr 2016
Hi, i have the same issue, that is preventing me from moving to Grafana 3.
Zabbix 2.4.3
grafana-zabbix beta 3
Grafana 3.0.0-beta1
Here is some profiling, i hope it helps. if not please contact me
vpuech
on 13 Apr 2016
Thanks!
alexanderzobnin
on 13 Apr 2016
@vpuech Do you see graph from Zabbix or dashboard can't load?
alexanderzobnin
on 13 Apr 2016
I see that v.onload function take most of time. Strange, it's Grafana function. Can you try another datasource (not Zabbix)?
alexanderzobnin
on 13 Apr 2016
@alexanderzobnin Yes, everything seams to work just fine except the lag.
i will try to test without zabbix datasource. i'll keep you posted
vpuech
on 13 Apr 2016
Added multiple graph from Elasticsearch and no issue so far
vpuech
on 13 Apr 2016
Ok, I see the same problem. Now I trying to collect CPU and memory profiles for detailed analyzing.
alexanderzobnin
on 13 Apr 2016
It's a great news, if you can reproduce the issue. Thanks you for you're great work. poke me if you need any help.
vpuech
on 13 Apr 2016
Can you get your full Grafana version (with commit hash - it's available at login page)?
alexanderzobnin
on 13 Apr 2016
@alexanderzobnin : Grafana version: 3.0.0-beta2, commit: v3.0-beta2, build date: 2016-04-04 13:52:41
vpuech
on 13 Apr 2016
Ok, thanks.
alexanderzobnin
on 13 Apr 2016
Seems, I found a reason... API response caching - cache grows and insert time also grows. I will try to fix it.
alexanderzobnin
on 13 Apr 2016
Thank you very much Alexander
vpuech
on 13 Apr 2016
Fix available in version 3.0.0-beta6. I've sent PR to grafana plugin repo so it will be available via grafana-cli soon. Or check out it from https://github.com/alexanderzobnin/grafana-zabbix-app
alexanderzobnin
on 13 Apr 2016
Now CPU profiles looks much better :+1:
alexanderzobnin
on 13 Apr 2016
Awesome! Thanks a ton!
On Wed, Apr 13, 2016 at 1:59 PM, Alexander Zobnin [email protected]
wrote:
Now CPU profiles looks much better [image: :+1:]
[image: screenshot from 2016-04-13 23 58 00]
https://cloud.githubusercontent.com/assets/4932851/14509168/a0aef422-01d3-11e6-8c6a-f48235a8a30a.png
[image: screenshot from 2016-04-13 23 57 52]
https://cloud.githubusercontent.com/assets/4932851/14509172/a34e0c54-01d3-11e6-8583-e520a7b27b27.png—
You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub
https://github.com/alexanderzobnin/grafana-zabbix/issues/196#issuecomment-209645369
mcbeenb
on 14 Apr 2016
Related issues
ufoloko
·
7Comments
alexanderzobnin
·
4Comments
Akabell95
·
8Comments
xiaoxue999
·
3Comments
heyrod
·
7Comments
Most helpful comment
Seems, I found a reason... API response caching - cache grows and insert time also grows. I will try to fix it.