logstash收集日志输出到es通过kibana做日志分析_利用logstash将lockbask日志文件上传到es,怎么配置

一、安装logstash, es, kibana

二、配置应用

1. 配置pom.xml,增加

        <dependency>
            <groupId>net.logstash.logback</groupId>
            <artifactId>logstash-logback-encoder</artifactId>
            <version>7.0.1</version>
        </dependency>
1
2
3
4
5

2.配置logback-spring.xml

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE configuration>
<configuration>
    <!-- 获取yml中的log ip端口地址 -->
    <springProperty scope="context" name="logHost" source="logstash.hosts" defaultValue="localhost:5044"/>
    <appender name="LOGSTASH" class="net.logstash.logback.appender.LogstashTcpSocketAppender">
        <destination>${logHost}</destination>
        <encoder charset="UTF-8" class="net.logstash.logback.encoder.LogstashEncoder" />
    </appender>

    <include resource="org/springframework/boot/logging/logback/base.xml"/>

    <root level="INFO">
        <appender-ref ref="LOGSTASH" />
        <appender-ref ref="CONSOLE" />
    </root>

</configuration>

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19

3.logstash配置

input{
        tcp {
                mode => "server"
                host => "0.0.0.0"
                port => 5044
                codec => json_lines
        }
}
output{
  elasticsearch {
      #ESIP地址与端口
      hosts => "172.20.10.54:9200"
      #ES索引名称（自己定义的）
      index => "kafka-base-produder-log"
  } 
}
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16

三、配置kibana

1.选择Management下的Stack Management

2.点击Data Views然后Create data view

3. Analytics下的Discover，选择刚刚的data view

4. 点击Refresh就出现了日志了