spring-boot-elasticsearch

To support elasticsearch v5.5.1 with spring-boot v2.0.0.M3 and Kibana v5.5.1, Fluentd v2.3.

Java v1.8
Gradle v4.0.1
Spring Boot v2.0.0.M3
Tomcat v8
Elasticsearch v5.5.1
Kibana v5.5.1
Fluentd v2.3
Spock(Groovy v2.4.12) v1.1

How to Use

only Mac OS

Install Java

brew cask install java

Install Elasticsearch

brew install elasticsearch
elasticsearch -V
elasticsearch # Start Elasticsearch.

Install Kibana

brew install kibana
kibana -V
kibana # Start Kibana.

Install this project

git clone git@github.com:ogasawaraShinnosuke/spring-boot-elasticsearch.git
cd spring-boot-elasticsearch
./gradlew clean
./gradlew build
./gradlew bootRun

Test

./gradlew test

# Coverage Report
./gradlew jacocoTestReport
open build/jacocoHtml/index.html (Optional)

Install Fluentd

wget http://packages.treasuredata.com.s3.amazonaws.com/2/macosx/td-agent-2.3.0-0.dmg # Execute this dmg-file. 
sudo /opt/td-agent/embedded/bin/fluent-gem install fluent-plugin-elasticsearch # Install gem for Fluentd.
sudo launchctl unload /Library/LaunchDaemons/td-agent.plist # Invalidate settings.
sudo launchctl load /Library/LaunchDaemons/td-agent.plist # Activate settings.

Settinds td-agent.conf

Request examples

Check kibana

Access to http://localhost:5601

Insert data

curl -XPOST http://localhost:8080/crypto-currencies -d '{"name":"bitcoin","marketCapitalization":46219389522.4,"keywords": ["bitcoin","BTC"]}'
curl -XPOST http://localhost:8080/crypto-currencies -d '{"name":"Ethereum","marketCapitalization":31278008829.5,"keywords": ["Ethereum","ETH"]}'
curl -XPOST http://localhost:8080/crypto-currencies -d '{"name":"Ripple","marketCapitalization":12034938611.6,"keywords":["Ripple","XRP"]}'

Check this data

curl http://localhost:9200/crypto-currencies/_search\?pretty

Operation data

# want to find list
curl -XGET http://localhost:8080/crypto-currencies

# want to find query (include `i` for name parameter)
curl -XGET http://localhost:8080/crypto-currencies?name=*i*

# want to find docID (`AVzJU4hHoL2ZelEv7YH5` is uniq docID)
curl -XGET http://localhost:8080/crypto-currencies/AVzJU4hHoL2ZelEv7YH5

# want to delete docID (`AVzJU4hHoL2ZelEv7YH5` is uniq docID)
curl -XDELETE http://localhost:8080/crypto-currencies/AVzJU4hHoL2ZelEv7YH5

Search by numerical value, List and BetWeen are not implemented yet

Summary Matrix System

Fluentd is to build Tomcat’s unified logging layer with Elasticsearch, Kibana.

tomcat - fluentd
  |         |
 elasticsearch
      |
    kibana

Server	Port	Built In	Homebrew	dmg	Version
Tomcat	8080	:heavy_check_mark:			v2.0.0.M3
Fluentd	8888,24230			:heavy_check_mark:	v2.3
Elasticsearch	9200,9300	:heavy_check_mark:	:heavy_check_mark:		v5.4.2
Kibana	5601		:heavy_check_mark:		v5.4.2

It’s also possible to use Logstash and Beats.