Kibana research - visualization and configuration

[KingOfPoptart]

Kibana is up and running the cluster and its configured to talk with elastic search! This is good, but we need to do some research to figure out how to automate the process of deploying kibana as well as how to use it best.

Setup:

1. Run one of the integration tests (remove the --clean-containers line so that your cluster stays up). You may need to rebuild images if its been a while
2. Make sure you've run a dataflow so that there is data in elasticsearch
3. Kibana will be running at http://generic-1:5601

Requirements:

1. Click on the visualize tab - there are lots of different bars and charts. Play around with these, get a feel for how they look and what they can do. Prepare a demo of different kinds of charts using Scribengin logs
2. You can save queries for later use. Where do these queries get stored? We want to be able to deploy kibana with a set of already pre-defined queries when its launched
3. Prepare a visualization/graph/chart that shows the combination of errors and warnings in a meaningful way.

Please coordinate with Tuan and myself on Monday for this task - Tuan can do a quick run-through of Kibana and what we're looking for. Make sure you understand how Kibana works and see if anyone else has done anything like this before to make your life easier. If there's a "correct" way of deploying Kibana with already created configurations, then lets figure that out

[tuan08]

The goal is to present the log data that the admin can find the error , compare the number or error , warning(for ex error on the worker-1 , and worker-2).

It is your job to research , present the data. Reorganize the the index add or request the missing fields to achieve your goal

[tuan08]

In case the log index data does not allow , use elasticsearch api , create new index and insert some data and draw the sample chart according to this document https://www.timroes.de/2015/02/07/kibana-4-tutorial-part-3-visualize/