Please help me in enabling this python.d plugin ?
Firstly, please create a step by step guide to enable this.
I have done this to my files,
https://bpaste.net/show/1a824fbfd8d3
Please tell me if I need to do anything else, and also explain about this 'retries : 10', what does it mean ? I can browse to the page netdatamonitor.com/stub_status , but does not see any kind of graphs there, just some info in text in available.
Do this:
wget 'http://192.168.122.245/stub_status'
wget 'http://netdatamonitor.com/stub_status'
wget 'http://127.0.0.1/stub_status'
do they work?
If not, you need an nginx guide to enable stub_status
.
luvpreet@luvpreet-vm:/$ sudo wget 'http://netdatamonitor.com/stub_status'
[sudo] password for luvpreet:
--2017-03-07 12:57:27-- http://netdatamonitor.com/stub_status
Resolving netdatamonitor.com (netdatamonitor.com)... 192.168.122.245
Connecting to netdatamonitor.com (netdatamonitor.com)|192.168.122.245|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 101 [text/plain]
Saving to: ‘stub_status’
100%[=====================================================================================================>] 101 --.-K/s in 0s
2017-03-07 12:57:27 (16.8 MB/s) - ‘stub_status’ saved [101/101]
luvpreet@luvpreet-vm:/$ curl 'http://netdatamonitor.com/stub_status'
Active connections: 2
server accepts handled requests
13 13 131
Reading: 0 Writing: 1 Waiting: 1
The same curl reponse is seen in the browser, the module is working sir, but python.d is not enabled correctly I think.
ok, let's try this:
# become user netdata
su -s /bin/sh netdata
# execute the nginx module by hand
/usr/libexec/netdata/plugins.d/python.d.plugin debug 1 nginx
Can you post the output?
I have simply run it and this is the output.
2017-03-07 13:36:35: INFO: Using python v2
2017-03-07 13:36:35: INFO: YAML output is ordered
2017-03-07 13:36:35: python.d INFO: reading configuration file: /etc/netdata/python.d.conf
2017-03-07 13:36:35: python.d ERROR: /etc/netdata/python.d.conf is not a valid configuration file
2017-03-07 13:36:35: python.d INFO: MODULES_DIR='/usr/libexec/netdata/python.d/', CONFIG_DIR='/etc/netdata/', UPDATE_EVERY=1, ONLY_MODULES=['nginx']
2017-03-07 13:36:35: python.d DEBUG: nginx: loading module configuration: '/etc/netdata/python.d/nginx.conf'
2017-03-07 13:36:35: python.d ERROR: /etc/netdata/python.d/nginx.conf is not a valid configuration file
2017-03-07 13:36:35: python.d DEBUG: nginx: reading configuration
2017-03-07 13:36:35: python.d DEBUG: nginx: job added
2017-03-07 13:36:35: python.d DEBUG: all job objects [
2017-03-07 13:36:35: python.d ERROR: nginx_local check() failed - disabling job
2017-03-07 13:36:35: python.d ERROR: DISABLED: nginx/local
2017-03-07 13:36:35: python.d DEBUG: overridden job names: []
2017-03-07 13:36:35: python.d DEBUG: all remaining job objects: []
2017-03-07 13:36:35: python.d FATAL: no more jobs
DISABLE
Here is the pyhton.d.conf file https://bpaste.net/show/ca4f9a6374b9
@sLuvpreet33
2017-03-07 13:36:35: python.d ERROR: /etc/netdata/python.d.conf is not a valid configuration file
2017-03-07 13:36:35: python.d ERROR: /etc/netdata/python.d/nginx.conf is not a valid configuration file
export NETDATA_CONFIG_DIR=/opt/netdata/etc/netdata/ # change DIR if you need to
./python.d.plugin debug 1 nginx
I didnt get you @l2isbad , how to do that ?
CONFIG_DIR is '/etc/netdata' if there is no NETDATA_CONFIG_DIR env var.
Since you run the command from your shell NEDATA_CONFIG_DIR is missing.
You need to export NETDATA_CONFIG_DIR before run the python.d.plugin (only when you run it by hand).
(as root)
cd /path/to/python.d.plugin
export NETDATA_CONFIG_DIR=/opt/netdata/etc/netdata/ # path to python.d.conf
then run python.d.plugin from shell (as root)
./python.d.plugin debug 1 nginx
sir there is no file as ./python.d.plugin ,
./python.d.plugin debug 1 nginx , cant be run.
What is your install directory for netdata?
/etc/netdata/
Try to run python.d.plugin
as root then
I see in your output
2017-03-07 13:36:35: python.d ERROR: /etc/netdata/python.d.conf is not a valid configuration file
This means that either the directory is invalid or file is not readable
What is the correct file and just tell me where to store this file.
python.d.plugin debug 1 nginx
as rootnetdata.conf
, python.d.conf
files). Then run as root.luvpreet@luvpreet-vm:/usr/libexec/netdata/plugins.d$ sudo ./python.d.plugin debug 1 nginx
2017-03-07 14:53:19: INFO: Using python v2
2017-03-07 14:53:19: INFO: YAML output is ordered
2017-03-07 14:53:19: python.d INFO: reading configuration file: /etc/netdata/python.d.conf
Traceback (most recent call last):
File "./python.d.plugin", line 579, in
run()
File "./python.d.plugin", line 516, in run
conf = read_config(configfile)
File "./python.d.plugin", line 457, in read_config
msg.error(str(path), "is malformed:", e)
File "/usr/libexec/netdata/python.d/python_modules/msg.py", line 75, in error
log_msg("ERROR", *args)
File "/usr/libexec/netdata/python.d/python_modules/msg.py", line 38, in log_msg
msg = "%s: %s %s: %s" % (timestamp, PROGRAM, str(msg_type), " ".join(args))
TypeError: sequence item 2: expected string, ParserError found
Well, look here https://github.com/firehol/netdata/issues/1864 (at the end)
Take a look now, directory error is solved, there was an identation error actually, but what now ?
luvpreet@luvpreet-vm:/usr/libexec/netdata/plugins.d$ sudo ./python.d.plugin debug 1 nginx
2017-03-07 15:07:19: INFO: Using python v2
2017-03-07 15:07:19: INFO: YAML output is ordered
2017-03-07 15:07:19: python.d INFO: reading configuration file: /etc/netdata/python.d.conf
2017-03-07 15:07:19: python.d INFO: MODULES_DIR='/usr/libexec/netdata/python.d/', CONFIG_DIR='/etc/netdata/', UPDATE_EVERY=1, ONLY_MODULES=['nginx']
2017-03-07 15:07:19: python.d DEBUG: nginx: loading module configuration: '/etc/netdata/python.d/nginx.conf'
2017-03-07 15:07:19: python.d DEBUG: nginx: reading configuration
2017-03-07 15:07:19: python.d DEBUG: nginx/RemoteNginx: job added
2017-03-07 15:07:19: python.d DEBUG: nginx/localipv4: job added
2017-03-07 15:07:19: python.d DEBUG: nginx/localipv6: job added
2017-03-07 15:07:19: python.d DEBUG: all job objects [
2017-03-07 15:07:19: python.d ERROR: nginx_RemoteNginx check() failed - disabling job
2017-03-07 15:07:19: python.d ERROR: DISABLED: nginx/RemoteNginx
2017-03-07 15:07:19: python.d ERROR: nginx_localipv4 HTTP Error 404: Not Found
2017-03-07 15:07:19: python.d ERROR: nginx_localipv4 check() failed - disabling job
2017-03-07 15:07:19: python.d ERROR: DISABLED: nginx/localipv4
2017-03-07 15:07:19: python.d ERROR: nginx_localipv6
2017-03-07 15:07:19: python.d ERROR: nginx_localipv6 check() failed - disabling job
2017-03-07 15:07:19: python.d ERROR: DISABLED: nginx/localipv6
2017-03-07 15:07:19: python.d DEBUG: overridden job names: []
2017-03-07 15:07:19: python.d DEBUG: all remaining job objects: []
2017-03-07 15:07:19: python.d FATAL: no more jobs
DISABLE
Hey, the command sudo ./python.d.plugin debug 1 nginx
is working,
here is the output and it keeps on refreshing.
but the graphs are still not being shown on netdatamonitor.com/stub_status
2017-03-07 15:21:35: python.d DEBUG: nginx_Reverse_proxy sleeping for 0.998315095901 secs to reach frequency of 1.0 secs, now: 1488880296.0 next: 1488880297.0 penalty: 0
BEGIN nginx_Reverse_proxy.connections 999507
SET active = 2
END
BEGIN nginx_Reverse_proxy.requests 999507
SET requests = 122
END
BEGIN nginx_Reverse_proxy.connection_status 999507
SET reading = 0
SET writing = 1
SET waiting = 1
END
BEGIN nginx_Reverse_proxy.connect_rate 999507
SET accepts = 40
SET handled = 40
END
Better to use ip address in url. Restart netdata.service and look for nginx_Reverse_proxy in the dashboard.
And comment out all ReverseNginx:
jobs except the one you need.
I din't get that dashboard thing, please explain
dashboard is http://netdata.ip:19999
ReverseNginx: # i assume this one is correct
name : 'Reverse_Proxy'
url : 'http://192.168.122.245/stub_status'
#ReverseNginx:
# name : 'Reverse_proxy'
# url : 'http://netdatamonitor.com/stub_status'
# retries : 10
#ReverseNginx:
# name : 'Reverse_Proxy'
# url : 'http://127.0.0.1/stub_status'
# retries : 10
restart netdata.service
then
no graphs still !!
Please show netdata error.log.
cd to netdata log dir.
cp /dev/null error.log
systemctl restart netdata.service
grep nginx error.log
I couldn't find the error logs of netdata.
Is there any solution to it ?
I couldn't find the error logs of netdata.
check here
/var/log/netdata/
found error logs,
This is the result of grep nginx error.log
2017-03-07 20:08:32: charts.d: INFO: nginx: is disabled. Add a line with nginx=force in /etc/netdata/charts.d.conf to enable it (or remove the line that disables it).
2017-03-07 20:08:34: python.d INFO: web_log_nginx_log Collected data: ['url', 'code', 'bytes_sent', 'method', 'address']
2017-03-07 20:08:34: python.d INFO: CHECKED OK: web_log_nginx_log
2017-03-07 20:08:34: python.d INFO: RENAMED: web_log_nginx , from web_log_nginx_log
2017-03-07 20:08:37: python.d ERROR: web_log_nginx_log2 /var/log/nginx/localhost.access_log not readable or not exist
2017-03-07 20:08:37: python.d ERROR: web_log_nginx_log2 check() failed - disabling job
2017-03-07 20:08:37: python.d ERROR: DISABLED: web_log/nginx_log2
2017-03-07 20:08:37: python.d INFO: CHECKED OK: nginx_RemoteNginx
2017-03-07 20:08:37: python.d INFO: RENAMED: nginx_Reverse_proxy , from nginx_RemoteNginx
python.d INFO: CHECKED OK: nginx_RemoteNginx
Do you see any nginx_RemoteNginx thing in the dashboard menu (http://netdata.ip:19999) ?
have a look
I mean the thing on the right (menu).
Actually, this option is not there on my dashboard, and neither that (?help) option.
Was it released in a recent update or it is due to any other reason ?
Change your screen resolution...
yeah I see the help section, but nthng else
Because of your screen size. No space for menu.
This screen is vnc session from a vm, right?
To see netdata in your browser (no a vm browser)
ssh -L 127.0.0.1:19998:127.0.0.1:19999 <user>@<ip address of VM>
# run this from your PC
http://127.0.0.1:19998
well, that was one very simple and amazing idea !! Thank you very much
You can put configuration for local port forwarding to the /home/<user>/.ssh/config
Host <hostname>
HostName <ip address>
User <username>
LocalForward 127.0.0.1:19998 127.0.0.1:19999
then ssh <hostname>
Thank you for the suggestion.
On Wed, Mar 8, 2017 at 10:03 AM, Ilya Mashchenko notifications@github.com
wrote:
You can put configuration for local port forwarding to the
/home//.ssh/config Host
HostName
User
LocalForward 127.0.0.1:19998 127.0.0.1:19999then ssh
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/firehol/netdata/issues/1904#issuecomment-284944248,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AWDm_A6X_DufMB4OmqwG5EP5shh0Dc7vks5rji-mgaJpZM4MVH0C
.
https://github.com/firehol/netdata/tree/master/python.d#nginx_log
Where to specify these paths, I mean which file, can you tell me here?
On Wed, Mar 8, 2017 at 11:13 AM, Luvpreet Singh s.luvpreet33@gmail.com
wrote:
Thank you for the suggestion.
On Wed, Mar 8, 2017 at 10:03 AM, Ilya Mashchenko <[email protected]
wrote:
You can put configuration for local port forwarding to the
/home//.ssh/config Host
HostName
User
LocalForward 127.0.0.1:19998 127.0.0.1:19999then ssh
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/firehol/netdata/issues/1904#issuecomment-284944248,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AWDm_A6X_DufMB4OmqwG5EP5shh0Dc7vks5rji-mgaJpZM4MVH0C
.
nginx_log was replaced by web_log
Check web_log_nginx
in dashboard menu. It maybe already there.
yes, it was.
On Wed, Mar 8, 2017 at 11:55 AM, Ilya Mashchenko notifications@github.com
wrote:
nginx_log was replaced by web_log
https://github.com/firehol/netdata/blob/master/conf.d/python.d/web_log.conf
Check web_log_nginx in dashboard menu. It maybe already there.—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/firehol/netdata/issues/1904#issuecomment-284958423,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AWDm_ILRH75ueMbG4vy6E2-3JKj3GnjOks5rjknrgaJpZM4MVH0C
.
Can we monitor a specific port on which some process is running on our machine by using netdata?
On Wed, Mar 8, 2017 at 2:21 PM, Luvpreet Singh s.luvpreet33@gmail.com
wrote:
yes, it was.
On Wed, Mar 8, 2017 at 11:55 AM, Ilya Mashchenko <[email protected]
wrote:
nginx_log was replaced by web_log
https://github.com/firehol/netdata/blob/master/conf.d/python.d/web_log.conf
Check web_log_nginx in dashboard menu. It maybe already there.—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/firehol/netdata/issues/1904#issuecomment-284958423,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AWDm_ILRH75ueMbG4vy6E2-3JKj3GnjOks5rjknrgaJpZM4MVH0C
.
I think no. But please describe it in detail. How it supposed to work? What is "monitor a specific port"? Open or not?
For example, if django server is running on port 8000, then can we monitor
that port '8000' so that we can see how many requests are being passed on
to that port, and how many are being ignored ?
Something like that.
On Wed, Mar 8, 2017 at 2:50 PM, Ilya Mashchenko notifications@github.com
wrote:
I think no. But please describe it in detail. How it supposed to work?
What is "monitor a specific port"? Open or not?—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/firehol/netdata/issues/1904#issuecomment-284989351,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AWDm_MLxtfvp92xlJoL4Xb-Gmhjkj5LSks5rjnLSgaJpZM4MVH0C
.
It says that firehol must be installed to use FireQos , and iprange must be
installed to use it.
But I'm having trouble installing iprange.
I downloaded its tar file and unzip it, ran ./configure(it runs) but then,
make && make install gives me error.
Here is the O/P of make && make install
make all-am
make[1]: Entering directory /home/luvpreet/Downloads/iprange-1.0.3'
make[1]: Leaving directory
/home/luvpreet/Downloads/iprange-1.0.3'
make[1]: Entering directory /home/luvpreet/Downloads/iprange-1.0.3'
/bin/mkdir -p '/usr/local/bin'
/usr/bin/install -c iprange '/usr/local/bin'
/usr/bin/install: cannot remove ‘/usr/local/bin/iprange’: Permission denied
make[1]: *** [install-binPROGRAMS] Error 1
make[1]: Leaving directory
/home/luvpreet/Downloads/iprange-1.0.3'
make: * [install-am] Error 2
On Wed, Mar 8, 2017 at 3:29 PM, Ilya Mashchenko notifications@github.com
wrote:
I think you can use FireQos to achieve this. Take a look
http://london.my-netdata.io/default.html#menu_tc_submenu_eth0;theme=slate;help=true
.
And here
https://github.com/firehol/netdata/wiki/Monitor-application-bandwidth-with-Linux-QoS
.I mean you can graph all tcp port 8000 syn packets.
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/firehol/netdata/issues/1904#issuecomment-284998298,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AWDm_Dbq4i_iVYzX4gLsx5rPj5ytuSqFks5rjnwNgaJpZM4MVH0C
.
I am not sure you need iprange
. Anyway problems with iprange - https://github.com/firehol/iprange/issues
https://github.com/firehol/netdata/wiki/Monitor-application-bandwidth-with-Linux-QoS#qos-in-linux-have-you-lost-your-mind
look here, they are saying to install Firehol to write your own
FireQoS(which is written just below that) to enable the plugin, and to
install Firehol, I need "iprange".
Am I heading in the wrong direction ?
On Wed, Mar 8, 2017 at 5:28 PM, Ilya Mashchenko notifications@github.com
wrote:
I am not sure you need iprange. Anyway problems with iprange -
https://github.com/firehol/iprange/issues—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/firehol/netdata/issues/1904#issuecomment-285022631,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AWDm_J0Ll60etdkZzt1rst4un0o1pp-9ks5rjpf1gaJpZM4MVH0C
.
I have not followed the entire thread, so excuse me if I say something out of context:
fireqos will help you monitor the bandwidth of specific ports. If you have web server log files for the requests these ports serve, you can also use web_log plugin (it will not be as accurate as fireqos, but it will give you an indication).
Okay I have got Quality of Service(QoS) on my dashboard.
I can see the ssh service in my graphs in QoS which is running on port 22.
Is there any way I can add any port(like 8000) to Fireqos.conf, and see the
live status of that port in QoS ?
On Thu, Mar 9, 2017 at 5:18 AM, Costa Tsaousis notifications@github.com
wrote:
I have not followed the entire thread, so excuse me if I say something out
of context:fireqos will help you monitor the bandwidth of specific ports. If you have
web server log files for the requests these ports serve, you can also use
web_log plugin (it will not be as accurate as fireqos, but it will give you
an indication).—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/firehol/netdata/issues/1904#issuecomment-285208080,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AWDm_G_LGuBDuV7H0uKLdADKRt-eQyQ9ks5rjz5agaJpZM4MVH0C
.
Yes of course. Follow the fireqos tutorial to learn how you can configure fireqos.
What is the difference between eth0 world under Quality of Service and eth0
under Network Interfaces on the dashboard ?
On Fri, Mar 10, 2017 at 3:01 AM, Costa Tsaousis notifications@github.com
wrote:
Yes of course. Follow the fireqos tutorial
https://github.com/firehol/firehol/wiki/FireQOS-Tutorial to learn how
you can configure fireqos.—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/firehol/netdata/issues/1904#issuecomment-285489784,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AWDm_IhwKrt4aSgtQ8_x7jDQI8dulRNgks5rkG-5gaJpZM4MVH0C
.
QoS breaks down the interface traffic per service/class you define in fireqos.conf - other than that they are the same.
Well, thank you for that, and netdata is awesome !!
But sometimes(in a span of 2 days, but gets automatically resolved after 5
mins), this issue comes up.
On Fri, Mar 10, 2017 at 12:53 PM, Costa Tsaousis notifications@github.com
wrote:
QoS breaks down the interface traffic per service/class you define in
fireqos.conf - other than that they are the same.—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/firehol/netdata/issues/1904#issuecomment-285597065,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AWDm_HjPZjGGjiisSkbmZCHpmQTTOXi7ks5rkPp8gaJpZM4MVH0C
.
thanks!
But sometimes(in a span of 2 days, but gets automatically resolved after 5
mins), this issue comes up.
which issue?
hm... strange...
/var/log/netdata/access.log
about this? Can you post it?It happens when I restart the netdata service.
On Sat, Mar 11, 2017 at 3:19 AM, Costa Tsaousis notifications@github.com
wrote:
hm... strange...
- does it happen only when you start firefox or at any point?
- If you hit F5 is it downloaded successfully?
- Do you have a log at /var/log/netdata/access.log about this? Can
you post it?—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/firehol/netdata/issues/1904#issuecomment-285793990,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AWDm_JBpc-VmpumH-PK1zbXouKmMhx-Yks5rkcVpgaJpZM4MVH0C
.
ok. let check I understood this right:
Could you please give me the steps to reproduce it?
channel 4: open failed: connect failed: Connection refused
This is the error always. It happens when I make changes to Fireqos.conf
and restart netdata after that.
Please tell me if the problem is in netdata or my system, and the solution
also.
On Sat, Mar 11, 2017 at 5:19 PM, Costa Tsaousis notifications@github.com
wrote:
ok. let check I understood this right:
- netdata is started and is working
- firefox displays already the netdata dashboard
- you restart netdata.service and you get this?
Could you please give me the steps to reproduce it?
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/firehol/netdata/issues/1904#issuecomment-285861884,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AWDm_PM0LevomzEucuv54NUO-BYWwjmXks5rkootgaJpZM4MVH0C
.
This is what it shows after some time.
Takes some time and displays the regular correct view after that.
Hi Costa, did you get anything for this problem?
On Mon, Mar 13, 2017 at 4:02 AM, Luvpreet Singh s.luvpreet33@gmail.com
wrote:
channel 4: open failed: connect failed: Connection refused
This is the error always. It happens when I make changes to Fireqos.conf
and restart netdata after that.
Please tell me if the problem is in netdata or my system, and the solution
also.On Sat, Mar 11, 2017 at 5:19 PM, Costa Tsaousis notifications@github.com
wrote:ok. let check I understood this right:
- netdata is started and is working
- firefox displays already the netdata dashboard
- you restart netdata.service and you get this?
Could you please give me the steps to reproduce it?
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/firehol/netdata/issues/1904#issuecomment-285861884,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AWDm_PM0LevomzEucuv54NUO-BYWwjmXks5rkootgaJpZM4MVH0C
.
Did anybody get something on it?
@sLuvpreet33 I need steps to reproduce this. Without these, I don't really know how to help...
What is this machine-ubuntu 14.04 ?
Is this my virtual machine ?
And suddenly other server's netdata has gone empty, why so?😕
Most helpful comment
This screen is vnc session from a vm, right?
To see netdata in your browser (no a vm browser)
ssh -L 127.0.0.1:19998:127.0.0.1:19999
<user>@<ip address of VM>
# run this from your PChttp://127.0.0.1:19998