Skip to main content

Posts

Showing posts with the label ELK STACK

Log Aggregation with ELK stack and Spring Boot

Introduction In order to be able to search our logs based on a key/value pattern, we need to prepare our application to log and send information in a structured way to our log aggregation tool. In this article I am going to show you how to send structured log to ElasticSearch using Logstash as a data pipeline tool and how to visualize and filter log information using Kibana. According to a definition from the Wikipedia website: Elasticsearch is a search engine based on the Lucene library. It provides a distributed, multitenant-capable full-text search engine with an HTTP web interface and schema-free JSON documents. According to Elasticsearch platform website , Elasticsearch is the heart of the Elastic stack, which centrally stores your data for lightning fast search. The use of Elasticsearch, Kibana, Beats and Logstash as a search platform is commonly known as the ELK stack. Next we are going to start up Elasticsearch, Kibana and Logstash using docker so we can better underst...

What is the Elastic Stack and how to post data to an ElasticSearch DB in an Amazon ES Service

Amazon ES Service is a fully managed system that makes it easy to deploy Elastic Stack to AWS servers in an integrated way. Some features like installing Kibana plugins are not yet available. ElasticSearch is part of the Elastic Stack, a group of tools/services from the Elastic Company (elastic.co) Elastic Stack: * Kibana * ElasticSearch * Beats * Logstash ElasticSearch is a NoSQL document database and is most common used with Kibana , a UI tool to visualize data from the ES database. ElasticSearch is used for high speed text search. It was previously known as the ELK Stack because of the tools/services from Elastic Company that are used togheter: * ElasticSearch * Logstash * Kibana In elasticsearch db you post data to an index in the same way you insert data into tables in a RDBMS (Relational Database Management Systems). We use index to separate and group different types of information (data) in the same way we use tables in a database. SO INDEXES ARE FOR ES...