Elastic_Search_Practice

This repo is about making a Elastic Stack on a local machine. I will explain everything for MacOS. If you want to implement for different machine you can find alternative links on official website.

Elastic Stack is a stack includes every important that you will need when you want to use ElasticSearch.

Official Document of Elastic Stack : https://www.elastic.co/guide/en/elastic-stack/current/overview.html

This repo will explain every step to make an Elastic Stack. Also there will be a demo to upload data to server and use some ElasticSearch commands.

STEP 1 Install Elastic Search

The core part of Elastic Stack is ElasticSearch. We need to download ElasticSearch and run server on local machine.

Download Link : https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-7.6.2-darwin-x86_64.tar.gz

(for alternative links : https://www.elastic.co/guide/en/elasticsearch/reference/7.6/targz.html)

After downloading ElasticSearch, unzip it.

Open Terminal.

Go to ElasticSearch folder with cd command on Terminal.

Run command below.

./bin/elasticsearch

To check if ElasticSearch is online, run the code below.

curl -X GET "localhost:9200/?pretty"

There should be a response like below.

{
  "name" : "Cp8oag6",
  "cluster_name" : "elasticsearch",
  "cluster_uuid" : "AT69_T_DTp-1qgIJlatQqA",
  "version" : {
    "number" : "7.6.2",
    "build_flavor" : "default",
    "build_type" : "tar",
    "build_hash" : "f27399d",
    "build_date" : "2016-03-30T09:51:41.449Z",
    "build_snapshot" : false,
    "lucene_version" : "8.4.0",
    "minimum_wire_compatibility_version" : "1.2.3",
    "minimum_index_compatibility_version" : "1.2.3"
  },
  "tagline" : "You Know, for Search"
}

STEP 2 Install Kibana

We will use Kibana to run Elastic command, analysis and visualization.

Download Link : https://artifacts.elastic.co/downloads/kibana/kibana-7.6.2-darwin-x86_64.tar.gz

(for alternative links : https://www.elastic.co/guide/en/kibana/7.6/targz.html#install-darwin64)

Important Note : Alternatively, you can download Kibana and/or, which contains only features that are available under the Apache 2.0 license. You can run regular version ElasticSearch with oss version Kibana and visa versa. They both need to be same version.

After downloading Kibana, unzip it.

Open a new Terminal. Do not close ElasticSearch Terminal window.

Go to Kibana folder with cd command on Terminal.

Run command below.

./bin/kibana

To check if Kibana is online, opene browser.

Write go to 127.0.0.1 address.

If you a see Kibana home page Kibana is online.

STEP 3 Install Logstash

We will use Logstash to upload and manipulate datas to Elastic search.

Download Link : https://www.elastic.co/downloads/logstash

After downloading Logstash, unzip it.

Logstash is a bit different from other tools. It has an input and output. Also It has a filter part that you can do manipulations on data.

To run Logstash properly we need to prepare conf file. In this conf file we need to define input port, how to filter the data and output port.

Conf file for out beuty dataset will be like below.

# Sample Logstash configuration for creating a simple
# Logstash -> Elasticsearch pipeline.

input {
  file {
    path => "/Users/volkansahin/Downloads/beautyBrandsDatabaselast.csv"
    start_position => "beginning"
  }
}

filter{
	csv {
		separator => ","
		columns =>["Brands","Website Link","Category","Skincare","Makeup","Hair","Country","Founded"]
	}
}

output {
  elasticsearch {
    hosts => ["http://localhost:9200"]
    index => "beautybrandsindex"
  }
}

We use this conf file to run logstash with the command below.

./bin/logstash -f config/logstash-beauty.conf

volkansahn/Elastic_Search_Practice

Elastic_Search_Practice

STEP 1 Install Elastic Search

STEP 2 Install Kibana

STEP 3 Install Logstash