i am trying to setup ELK stack with collectd on Ubuntu 16.04 LTS (so pretty much latest version of stack available)
kibana is behind nginx proxy (followed this guide https://www.digitalocean.com/community/tutorials/how-to-install-elasticsearch-logstash-and-kibana-elk-stack-on-ubuntu-16-04)
and all looking good up until going to kibana dashboard
Index Patterns
Warning No default index pattern. You must select or create one to continue.
unable to fetch mapping do you have indices matching the pattern
ELK stack is on one server so everything on localhost
:~# curl 127.0.0.1:9200`
{
"name" : "Flex",
"cluster_name" : "elk-00",
"version" : {
"number" : "2.3.3",
"build_hash" : "218bdf10790eef486ff2c41a3df5cfa32dadcfde",
"build_timestamp" : "2016-05-17T15:40:04Z",
"build_snapshot" : false,
"lucene_version" : "5.5.0"
},
"tagline" : "You Know, for Search"
:~# service logstash configtest
Configuration OK
My question, very specific
1. How do i create defualt index file?
2. What is path of this default index file or located? also i hear about .kibana, where is this file .kibana located?
3. Why wasn't this index file automatically created for me? What do i do to make sure it automatically works without manually doing anything else?
@babatundebusari I would suggest reading through the getting started guide (https://www.elastic.co/guide/en/kibana/current/getting-started.html). This will explain what a default index pattern is.
In a nutshell: it's not a file. You need to add data to elasticsearch. Once you have, you can configure an index pattern from the first screen you posted, which will tell Kibana where to look for you data in Elasticsearch.
If you have further issues, feel free to ask questions in our Discussion forums: https://discuss.elastic.co/c/kibana
so just load random data?
Also in this tutorial, where did the person load data to elasticsearch but their own setup worked.
Maybe they omitted that part but how come tutorials online never show the step to load data into elastic search?
Also do i just load "random" data into elasticsearch? just to let kibana work? i mean is that what is required?
Kibana is a tool for visualizing data in Elasticsearch, so yes, you need data in Elasticsearch to work with Kibana.
The docs page I linked you to specifically shows you how to load data.
I think that link my help create-pattern
@babatundebusari were you able to load the index? Am facing the same issue too!
have installed filebeat and configured everything.
If you've followed the steps described in - https://www.elastic.co/guide/en/kibana/current/getting-started.html) and after doing Loading Sample Data you see on http://localhost:9200/_cat/indices?v
the same (or simmilar)
health status index uuid pri rep docs.count docs.deleted store.size pri.store.size
yellow open shakespeare 38xy7pxLQtq7Yr2IAKvUPQ 5 1 111396 0 27.6mb 27.6mb
then you can place the name of the index in that form
I followed the steps described in - https://www.elastic.co/guide/en/kibana/current/getting-started.html) and after doing Loading Sample Data I see on http://localhost:9200/_cat/indices?v
health status index uuid pri rep docs.count docs.deleted store.size pri.store.size
yellow open shakespeare WRq2dTy8SEywC0RXXyqi0A 5 1 0 0 1.2kb 1.2kb
yellow open logstash-2015.05.20 6EA6TdEyS5SndNCNKwgEIA 5 1 0 0 1.2kb 1.2kb
yellow open bank 6FH3tOJTT9eOA8Pz0MUZUg 5 1 1000 0 496.7kb 496.7kb
yellow open .kibana RePbtsq3QRGhouDc7l_43g 1 1 1 0 3.6kb 3.6kb
yellow open logstash-2015.05.18 ZapQFYbBQw2pBbNxMHODQg 5 1 0 0 1.2kb 1.2kb
yellow open logstash-2015.05.19 vOT8Yg0PQ5WEg94mOb7ptA 5 1 0 0 1.2kb 1.2kb
then when I place the name of the index in that form as shakespeare and click on create button then nothing happens.
I was able to resolve this. The elasticsearch logs showed:
[o.e.c.r.a.DiskThresholdMonitor] [6orZRcf] high disk watermark [90%]
This was because all indexes get locked when the disk threshold is reached and never get unlocked when space is freed.
To unlock all indexes manually:
curl -XPUT -H "Content-Type: application/json" https://[YOUR_ELASTICSEARCH_ENDPOINT]:9200/_all/_settings -d '{"index.blocks.read_only_allow_delete": null}'
Got from : https://github.com/elastic/kibana/issues/13685
@sangeetawakhale I am getting facing the same issue right now.
Even after creating a new index its says "No default index pattern. You must select or create one to continue.". Can you help with this ?
Most helpful comment
@babatundebusari I would suggest reading through the getting started guide (https://www.elastic.co/guide/en/kibana/current/getting-started.html). This will explain what a default index pattern is.
In a nutshell: it's not a file. You need to add data to elasticsearch. Once you have, you can configure an index pattern from the first screen you posted, which will tell Kibana where to look for you data in Elasticsearch.
If you have further issues, feel free to ask questions in our Discussion forums: https://discuss.elastic.co/c/kibana