devbox
AllinToyou
这个屌丝很懒，什么也没留下！
关注作者
热门标签
热门文章
当前位置:   article > 正文

Springboot 集成 Es 的相关操作_springboot集成es

作者：AllinToyou | 2024-02-08 10:29:51

赞

踩

springboot集成es

注：文章皆为个人纪录，可用性请以最终结果为准，若有错还请大佬们指出，谢谢！

此文章重在spring boot中对6.3.2版本Es的各种操作，简单易学，暂不做基础概念梳理。

每个操作都已测试，请放心食用~~

步骤一：引入相关依赖

注：此处引入  elasticsearch-rest-high-level-client  的Java客户端，并且与Es相关所有工具的版本需保持一致！

  1. <?xml version="1.0" encoding="UTF-8"?>
  2. <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
  3.          xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 https://maven.apache.org/xsd/maven-4.0.0.xsd">
  4.     <modelVersion>4.0.0</modelVersion>
  5.     <parent>
  6.         <groupId>org.springframework.boot</groupId>
  7.         <artifactId>spring-boot-starter-parent</artifactId>
  8.         <version>2.5.4</version>
  9.         <relativePath/> <!-- lookup parent from repository -->
  10.     </parent>
  11.     <groupId>com.es</groupId>
  12.     <artifactId>example</artifactId>
  13.     <version>0.0.1-SNAPSHOT</version>
  14.     <name>example</name>
  15.     <description>Demo project for Elastic Search</description>
  16.     <properties>
  17.         <java.version>1.8</java.version>
  18.         <elasticsearch.version>6.3.2</elasticsearch.version>
  19.         <elasticsearch.clent.version>6.3.2</elasticsearch.clent.version>
  20.         <fastjson.version>1.2.61</fastjson.version>
  21.         <hutool.version>5.1.0</hutool.version>
  22.     </properties>
  23.  
  24.  
  25.     <dependencies>
  26.         <dependency>
  27.             <groupId>org.springframework.boot</groupId>
  28.             <artifactId>spring-boot-starter-web</artifactId>
  29.         </dependency>
  30.  
  31.         <dependency>
  32.             <groupId>org.projectlombok</groupId>
  33.             <artifactId>lombok</artifactId>
  34.             <optional>true</optional>
  35.         </dependency>
  36.         <dependency>
  37.             <groupId>org.springframework.boot</groupId>
  38.             <artifactId>spring-boot-starter-test</artifactId>
  39.             <scope>test</scope>
  40.         </dependency>
  41.         <dependency>
  42.             <groupId>com.alibaba</groupId>
  43.             <artifactId>fastjson</artifactId>
  44.             <version>${fastjson.version}</version>
  45.         </dependency>
  46.  
  47.         <dependency>
  48.             <groupId>cn.hutool</groupId>
  49.             <artifactId>hutool-all</artifactId>
  50.             <version>${hutool.version}</version>
  51.         </dependency>
  52.  
  53.         <!-- elasticsearch 依赖 -->
  54.         <dependency>
  55.             <groupId>org.elasticsearch</groupId>
  56.             <artifactId>elasticsearch</artifactId>
  57.             <version>${elasticsearch.version}</version>
  58.         </dependency>
  59.  
  60.         <!-- elasticsearch Java操作客户端依赖 -->
  61.         <dependency>
  62.             <groupId>org.elasticsearch.client</groupId>
  63.             <artifactId>elasticsearch-rest-high-level-client</artifactId>
  64.             <version>${elasticsearch.clent.version}</version>
  65.         </dependency>
  66.     </dependencies>
  67.  
  68.     <build>
  69.         <plugins>
  70.             <plugin>
  71.                 <groupId>org.springframework.boot</groupId>
  72.                 <artifactId>spring-boot-maven-plugin</artifactId>
  73.                 <configuration>
  74.                     <excludes>
  75.                         <exclude>
  76.                             <groupId>org.projectlombok</groupId>
  77.                             <artifactId>lombok</artifactId>
  78.                         </exclude>
  79.                     </excludes>
  80.                 </configuration>
  81.             </plugin>
  82.         </plugins>
  83.     </build>
  84.  
  85. </project>

步骤二：yml 配置

配好Es相关信息

  1. server:
  2.   port: 7777
  3.  
  4. spring:
  5.   application:
  6.     name: EsStudyTest
  7.  
  8. elasticsearch:
  9.   schema: http # 协议
  10.   address: 127.0.0.1:9200 # 连接地址（Es的 ip : port）
  11.   connectTimeout: 5000 # 连接超时时间
  12.   socketTimeout: 5000 # socket 连接超时时间
  13.   connectionRequestTimeout: 5000 # 获取连接的超时时间
  14.   maxConnectNum: 100 # 最大连接数
  15.   maxConnectPerRoute: 100 # 最大路由连接数
  16.

步骤三：创建Es的配置类

获取 RestHighLevelClient  的入口

  1. package com.es.example.config;
  2.  
  3. import org.apache.http.HttpHost;
  4. import org.elasticsearch.client.RestClient;
  5. import org.elasticsearch.client.RestClientBuilder;
  6. import org.elasticsearch.client.RestHighLevelClient;
  7. import org.springframework.beans.factory.annotation.Value;
  8. import org.springframework.context.annotation.Bean;
  9. import org.springframework.context.annotation.Configuration;
  10.  
  11. import java.util.ArrayList;
  12. import java.util.List;
  13.  
  14. /**
  15.  * ElasticSearch 连接配置
  16.  */
  17. @Configuration
  18. public class EsConfig {
  19.     /** 协议 */
  20.     @Value("${elasticsearch.schema}")
  21.     private String schema;
  22.  
  23.     /** 集群地址，如果有多个则用英文都好相隔 */
  24.     @Value("${elasticsearch.address}")
  25.     private String address;
  26.  
  27.     /** 连接超时时间 */
  28.     @Value("${elasticsearch.connectTimeout}")
  29.     private int connectTimeout;
  30.  
  31.     /** socket 连接超时时间 */
  32.     @Value("${elasticsearch.socketTimeout}")
  33.     private int socketTimeout;
  34.  
  35.     /** 获取连接的超时时间 */
  36.     @Value("${elasticsearch.connectionRequestTimeout}")
  37.     private int connectionRequestTimeout;
  38.  
  39.     /** 最大连接数 */
  40.     @Value("${elasticsearch.maxConnectNum}")
  41.     private int maxConnectNum;
  42.  
  43.     /** 最大路由连接数 */
  44.     @Value("${elasticsearch.maxConnectPerRoute}")
  45.     private int maxConnectPerRoute;
  46.  
  47.     @Bean
  48.     public RestHighLevelClient restHighLevelClient() {
  49.         // 组装集群地址
  50.         List<HttpHost> hostList = new ArrayList<>();
  51.         String[] hostArray = address.split(",");
  52.         for (String addr : hostArray) {
  53.             String host = addr.split(":")[0];
  54.             String port = addr.split(":")[1];
  55.             hostList.add(new HttpHost(host, Integer.parseInt(port), schema));
  56.         }
  57.         HttpHost[] httpHost = hostList.toArray(new HttpHost[]{});
  58.  
  59.         // 构建连接对象
  60.         RestClientBuilder builder = RestClient.builder(httpHost);
  61.  
  62.         // 异步连接延时配置
  63.         builder.setRequestConfigCallback(requestConfigBuilder -> {
  64.             requestConfigBuilder.setConnectTimeout(connectTimeout);
  65.             requestConfigBuilder.setSocketTimeout(socketTimeout);
  66.             requestConfigBuilder.setConnectionRequestTimeout(connectionRequestTimeout);
  67.             return requestConfigBuilder;
  68.         });
  69.  
  70.         // 异步连接数配置
  71.         builder.setHttpClientConfigCallback(httpClientBuilder -> {
  72.             httpClientBuilder.setMaxConnTotal(maxConnectNum);
  73.             httpClientBuilder.setMaxConnPerRoute(maxConnectPerRoute);
  74.             return httpClientBuilder;
  75.         });
  76.  
  77.         return new RestHighLevelClient(builder);
  78.     }
  79. }

步骤四：创建自定义注解

用于在实体上说明Es的索引与type

  1. package com.es.example.annotations;
  2.  
  3. import java.lang.annotation.ElementType;
  4. import java.lang.annotation.Retention;
  5. import java.lang.annotation.RetentionPolicy;
  6. import java.lang.annotation.Target;
  7.  
  8. /**
  9.  * 自定义注解  声明Es的索引与type
  10.  */
  11. @Target({ElementType.TYPE}) // 声明注解使用类型
  12. @Retention(RetentionPolicy.RUNTIME) // 声明注解生命周期为运行时
  13. public @interface EsDocument {
  14.     /**
  15.      * 索引
  16.      */
  17.     String index();
  18.  
  19.     /**
  20.      * type
  21.      */
  22.     String type();
  23. }

步骤五：创建实体

  1. package com.es.example.entity;
  2.  
  3. import com.es.example.annotations.EsDocument;
  4. import lombok.AllArgsConstructor;
  5. import lombok.Builder;
  6. import lombok.Data;
  7. import lombok.NoArgsConstructor;
  8. import org.springframework.format.annotation.DateTimeFormat;
  9.  
  10. import java.util.Date;
  11.  
  12. @Data
  13. @Builder
  14. @EsDocument(index = "test20210910", type = "doc") // 自定义注解，声明Es的索引与type
  15. @NoArgsConstructor
  16. @AllArgsConstructor
  17. public class UserInfo {
  18.     /**
  19.      * 姓名
  20.      */
  21.     private String name;
  22.  
  23.     /**
  24.      * 年龄
  25.      */
  26.     private Integer age = 0;
  27.  
  28.     /**
  29.      * 生日
  30.      */
  31.     @DateTimeFormat(pattern = "yyyy-MM-dd")
  32.     private String birthday;
  33.  
  34.     /**
  35.      * 工资
  36.      */
  37.     private Integer salary = 0;
  38.  
  39.     /**
  40.      * 地址
  41.      */
  42.     private String address;
  43.  
  44.     /**
  45.      * 备注
  46.      */
  47.     private String remark;
  48.  
  49.     /**
  50.      * 测试数据
  51.      */
  52.     private String sayWords;
  53.  
  54.     /**
  55.      * 创建时间
  56.      */
  57.     private Date createTime;
  58. }

步骤六：开始花式操作

说明

此步骤中的方法相对全面，且每一步都有注释，以及逻辑之间我都会做明显分隔，便于理解，

前部分做索引与文档的增删改操作，后半部分做查询操作，有明显分割提示，所有操作都在一个类中，成员变量共享，

但是我没有做每个方法的具体响应示例，重在"授人以渔"。

后面的一系列查询操作思路核心就五步：

第一步：创建查询条件；

第二步：创建查询源构建器，并将查询条件配置其中；

第三步：创建请求；

第四步：调用 RestHighLevelClient 客户端去获取请求响应体；

第五步：解析响应体

6.1 创建索引

  1. package com.es.example.service.impl;
  2.  
  3. import cn.hutool.core.bean.BeanUtil;
  4. import cn.hutool.core.collection.CollectionUtil;
  5. import com.alibaba.fastjson.JSON;
  6. import com.es.example.annotations.EsDocument;
  7. import com.es.example.entity.UserInfo;
  8. import com.es.example.service.EsIndexOperationService;
  9. import lombok.extern.slf4j.Slf4j;
  10. import org.elasticsearch.action.admin.indices.create.CreateIndexRequest;
  11. import org.elasticsearch.action.admin.indices.create.CreateIndexResponse;
  12. import org.elasticsearch.action.admin.indices.delete.DeleteIndexRequest;
  13. import org.elasticsearch.action.admin.indices.delete.DeleteIndexResponse;
  14. import org.elasticsearch.action.bulk.BulkRequest;
  15. import org.elasticsearch.action.bulk.BulkResponse;
  16. import org.elasticsearch.action.delete.DeleteRequest;
  17. import org.elasticsearch.action.delete.DeleteResponse;
  18. import org.elasticsearch.action.get.GetRequest;
  19. import org.elasticsearch.action.get.GetResponse;
  20. import org.elasticsearch.action.index.IndexRequest;
  21. import org.elasticsearch.action.index.IndexResponse;
  22. import org.elasticsearch.action.search.SearchRequest;
  23. import org.elasticsearch.action.search.SearchResponse;
  24. import org.elasticsearch.action.update.UpdateRequest;
  25. import org.elasticsearch.action.update.UpdateResponse;
  26. import org.elasticsearch.client.RestHighLevelClient;
  27. import org.elasticsearch.common.settings.Settings;
  28. import org.elasticsearch.common.unit.Fuzziness;
  29. import org.elasticsearch.common.xcontent.XContentBuilder;
  30. import org.elasticsearch.common.xcontent.XContentFactory;
  31. import org.elasticsearch.common.xcontent.XContentType;
  32. import org.elasticsearch.index.query.BoolQueryBuilder;
  33. import org.elasticsearch.index.query.MatchAllQueryBuilder;
  34. import org.elasticsearch.index.query.QueryBuilders;
  35. import org.elasticsearch.rest.RestStatus;
  36. import org.elasticsearch.search.SearchHit;
  37. import org.elasticsearch.search.SearchHits;
  38. import org.elasticsearch.search.aggregations.AggregationBuilder;
  39. import org.elasticsearch.search.aggregations.AggregationBuilders;
  40. import org.elasticsearch.search.aggregations.Aggregations;
  41. import org.elasticsearch.search.aggregations.bucket.terms.Terms;
  42. import org.elasticsearch.search.aggregations.bucket.terms.TermsAggregationBuilder;
  43. import org.elasticsearch.search.aggregations.metrics.stats.ParsedStats;
  44. import org.elasticsearch.search.aggregations.metrics.tophits.ParsedTopHits;
  45. import org.elasticsearch.search.builder.SearchSourceBuilder;
  46. import org.elasticsearch.search.sort.SortOrder;
  47. import org.springframework.stereotype.Service;
  48.  
  49. import javax.annotation.Resource;
  50. import java.io.IOException;
  51. import java.util.ArrayList;
  52. import java.util.Date;
  53. import java.util.List;
  54.  
  55. /**
  56.  * Es索引相关操作
  57.  */
  58. @Service
  59. @Slf4j
  60. public class EsIndexOperationServiceImpl implements EsIndexOperationService {
  61.     /**
  62.      * 测试所用  ES文档id
  63.      */
  64.     private static final String TEST_ES_DOCUMENT_ID = "R0Xp3HsByDspl6UWckXA";
  65.  
  66.     /**
  67.      * 查询条件的字段
  68.      */
  69.     private static final String TEST_ES_DOCUMENT_QUERY_KEY = "address";
  70.  
  71.  
  72.     
  73.     @Resource
  74.     private RestHighLevelClient restHighLevelClient;
  75.  
  76.     /**
  77.      * 创建索引
  78.      *
  79.      * @return 创建成功与否
  80.      */
  81.     @Override
  82.     public String createIndex() {
  83.         try {
  84.             // 创建mapping
  85.             XContentBuilder mapping = getCreateIndexMapping();
  86.  
  87.             // 创建索引配置信息
  88.             Settings settings = Settings.builder()
  89.                     .put("index.number_of_shards", 1)
  90.                     .put("index.number_of_replicas", 0)
  91.                     .build();
  92.  
  93.             // 创建索引请求对象，然后设置索引类型（ES 7.0 将不在存在索引类型）和 mapping 与 index 配置
  94.             CreateIndexRequest request = new CreateIndexRequest("test20210910", settings);
  95.             request.mapping("doc", mapping);
  96.  
  97.             // 客户端执行创建索引的请求
  98.             CreateIndexResponse createIndexResponse = restHighLevelClient.indices().create(request);
  99.  
  100.             // 判断是否创建成功
  101.             boolean isCreated = createIndexResponse.isAcknowledged();
  102.             log.info("是否创建成功：[{}]", isCreated);
  103.  
  104.             return isCreated ? "创建成功" : "创建失败";
  105.         } catch (IOException e) {
  106.             e.printStackTrace();
  107.         }
  108.         return null;
  109.     }
  110.  
  111.     /**
  112.      * 获取创建索引的mapping
  113.      *
  114.      * @return mapping
  115.      * @throws IOException IO异常
  116.      */
  117.     private XContentBuilder getCreateIndexMapping() throws IOException {
  118.         // 对比ES原生创建索引Dsl语句，每一个startObject()与endObject()就相当于Dsl语句中的一组大括号 {}
  119.         return XContentFactory.jsonBuilder()
  120.                         .startObject()
  121.                         .field("dynamic", true)
  122.                         .startObject("properties")
  123.                         .startObject("name")
  124.                         .field("type", "text")
  125.                         .startObject("fields")
  126.                         .startObject("keyword")
  127.                         .field("type", "keyword")
  128.                         .endObject()
  129.                         .endObject()
  130.                         .endObject()
  131.  
  132.                         .startObject("address")
  133.                         .field("type", "text")
  134.                         .startObject("fields")
  135.                         .startObject("keyword")
  136.                         .field("type", "keyword")
  137.                         .endObject()
  138.                         .endObject()
  139.                         .endObject()
  140.  
  141.                         .startObject("remark")
  142.                         .field("type", "text")
  143.                         .startObject("fields")
  144.                         .startObject("keyword")
  145.                         .field("type", "keyword")
  146.                         .endObject()
  147.                         .endObject()
  148.                         .endObject()
  149.  
  150.                         .startObject("sayWords")
  151.                         .field("type", "text")
  152.                         .endObject()
  153.  
  154.                         .startObject("age")
  155.                         .field("type", "integer")
  156.                         .endObject()
  157.  
  158.                         .startObject("salary")
  159.                         .field("type", "integer")
  160.                         .endObject()
  161.  
  162.                         .startObject("birthDate")
  163.                         .field("type", "date")
  164.                         .field("format", "yyyy-MM-dd")
  165.                         .endObject()
  166.  
  167.                         .startObject("createTime")
  168.                         .field("type", "date")
  169.                         .endObject()
  170.                         .endObject()
  171.                         .endObject();
  172.     }

6.2 删除索引 

  1. /**
  2.      * 删除索引
  3.      *
  4.      * @return 是否删除成功
  5.      */
  6.     @Override
  7.     public String deleteIndex() {
  8.         try {
  9.             // 创建请求
  10.             DeleteIndexRequest request = new DeleteIndexRequest("test20210910");
  11.  
  12.             // 处理请求
  13.             DeleteIndexResponse response = restHighLevelClient.indices().delete(request);
  14.  
  15.             // 拿到结果
  16.             boolean isDelete = response.isAcknowledged();
  17.             log.info("是否删除成功：[{}]", isDelete);
  18.  
  19.             return isDelete ? "删除成功" : "删除失败";
  20.         } catch (IOException e) {
  21.             e.printStackTrace();
  22.         }
  23.         return null;
  24.     }

6.3 新增一条文档 

  1. /**
  2.      * 新增一条文档
  3.      *
  4.      * @return 是否新增成功
  5.      */
  6.     @Override
  7.     public String addADocument() {
  8.         // 创建请求
  9.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class); // 获取注解
  10.         IndexRequest request = new IndexRequest(annotation.index(), annotation.type());
  11.  
  12.         // 创建员工信息
  13.         UserInfo userInfo = UserInfo.builder()
  14.                 .name("王五")
  15.                 .age(9)
  16.                 .salary(1100)
  17.                 .address("天津市")
  18.                 .remark("来自北京市的王先生")
  19.                 .sayWords("啊阿萨飒飒")
  20.                 .createTime(new Date())
  21.                 .birthday("1991-01-01").build();
  22.  
  23.         /*
  24.         将对象转为JSON数组
  25.         不转为JSON格式并且不声明的话会报错java.lang.IllegalArgumentException: The number of object passed must be even but was [1])
  26.         意为 request.source(userInfo) 方法不知道userInfo是什么类型的数据
  27.         */
  28.         byte[] json = JSON.toJSONBytes(userInfo);
  29.  
  30.         // 设置文档内容
  31.         request.source(json, XContentType.JSON); // 声明类型
  32.         try {
  33.             // 执行请求
  34.             IndexResponse response = restHighLevelClient.index(request);
  35.             log.info("新增一条文档的结果状态：[{}]", response.status());
  36.         } catch (IOException e) {
  37.             e.printStackTrace();
  38.         }
  39.         return "新增一条文档成功";
  40.     }

6.4 批量新增文档 

  1. /**
  2.      * 批量新增文档
  3.      *
  4.      * @return 是否新增成功
  5.      */
  6.     @Override
  7.     public String addBulkDocument() {
  8.         // 创建数据集
  9.         List<UserInfo> userInfoList = new ArrayList<>();
  10.         for (int i = 0; i <= 10; i++) {
  11.             UserInfo userInfo = UserInfo.builder()
  12.                     .name("用户" + i)
  13.                     .age(i)
  14.                     .salary(i * 100 + 100)
  15.                     .address("用户" + i + "住在" + i + "号街区")
  16.                     .remark("这是第" + i + "条文档信息的批量插入")
  17.                     .sayWords("大大慢慢那得看" + i)
  18.                     .createTime(new Date())
  19.                     .birthday("199" + i + "-01-01").build();
  20.             userInfoList.add(userInfo);
  21.         }
  22.  
  23.         // 获取注解
  24.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  25.  
  26.         // 创建批量插入的请求
  27.         BulkRequest bulkRequest = new BulkRequest();
  28.         for (UserInfo userInfo : userInfoList) {
  29.             IndexRequest request = new IndexRequest(annotation.index(), annotation.type());
  30.             /*
  31.             * 将对象转为JSON数组
  32.               不转为JSON格式并且不声明的话会报错java.lang.IllegalArgumentException: The number of object passed must be even but was [1])
  33.               意为 request.source(userInfo) 方法不知道userInfo是什么类型的数据
  34.             *  */
  35.             byte[] json = JSON.toJSONBytes(userInfo);
  36.             request.source(json, XContentType.JSON); // 声明类型
  37.             bulkRequest.add(request);
  38.         }
  39.  
  40.         // 执行批量请求
  41.         BulkResponse response = null;
  42.         try {
  43.             response = restHighLevelClient.bulk(bulkRequest);
  44.             log.info("新增一条文档的结果状态：[{}]", response.status().getStatus());
  45.         } catch (IOException e) {
  46.             e.printStackTrace();
  47.         }
  48.         return response != null && response.status().getStatus() == 200 ? "批量新增文档成功" : "批量新增文档失败";
  49.     }

6.5 更新文档 

  1. /**
  2.      * 更新文档
  3.      *
  4.      * @return 是否更新成功
  5.      */
  6.     @Override
  7.     public String updateDocument() {
  8.         // 设置更新数据
  9.         UserInfo update = UserInfo.builder().address("湖南省常德市").build();
  10.         byte[] json = JSON.toJSONBytes(update);
  11.  
  12.         // 创建请求
  13.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  14.         UpdateRequest request = new UpdateRequest(annotation.index(), annotation.type(), TEST_ES_DOCUMENT_ID);
  15.         request.doc(json, XContentType.JSON);
  16.  
  17.         // 处理请求
  18.         UpdateResponse response = null;
  19.         try {
  20.             response = restHighLevelClient.update(request);
  21.             log.info("更新一条文档的结果状态：[{}]", response.status().getStatus());
  22.         } catch (IOException e) {
  23.             e.printStackTrace();
  24.         }
  25.         return response != null && response.status().getStatus() == 200 ? "更新成功" : "更新失败";
  26.     }

6.6 删除文档

  1. /**
  2.      * 删除文档
  3.      *
  4.      * @return 是否删除成功
  5.      */
  6.     @Override
  7.     public String deleteDocument() {
  8.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  9.         DeleteRequest request = new DeleteRequest(annotation.index(), annotation.type(), TEST_ES_DOCUMENT_ID);
  10.  
  11.         DeleteResponse response = null;
  12.         try {
  13.             response = restHighLevelClient.delete(request);
  14.             log.info("删除一条文档的结果状态：[{}]", response.status().getStatus());
  15.         } catch (IOException e) {
  16.             e.printStackTrace();
  17.         }
  18.         return response != null && response.status().getStatus() == 200 ? "删除成功" : "删除失败";
  19.     }

以下为各种查询操作 

6.7 根据id获取文档 

  1. /**
  2.      * 根据id获取文档
  3.      *
  4.      * @return 文档结果
  5.      */
  6.     @Override
  7.     public UserInfo getDocument() {
  8.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  9.         GetRequest request = new GetRequest(annotation.index(), annotation.type(), TEST_ES_DOCUMENT_ID);
  10.         GetResponse response = null;
  11.         try {
  12.             response = restHighLevelClient.get(request);
  13.             log.info("根据id查询的响应体：" + response);
  14.         } catch (IOException e) {
  15.             e.printStackTrace();
  16.         }
  17.         if (response != null) {
  18.             UserInfo userInfo = JSON.parseObject(response.getSourceAsBytes(), UserInfo.class);
  19.             log.info("获取查询结果：" + userInfo);
  20.             return BeanUtil.isEmpty(userInfo) ? null : userInfo;
  21.         }
  22.         return null;
  23.     }

6.8 精确查询 

查询条件不会进行分词，但是查询内容可能会分词，导致查询不到

  1. /**
  2.      * 精确查询（查询条件不会进行分词，但是查询内容可能会分词，导致查询不到）
  3.      *
  4.      * @return 查询结果
  5.      */
  6.     @Override
  7.     public List<UserInfo> termQuery() {
  8.         // 构建查询条件（注意：termQuery 支持多种格式查询，如 boolean、int、double、string 等，这里使用的是 string 的查询）
  9.         SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
  10.         searchSourceBuilder.query(QueryBuilders.termQuery(TEST_ES_DOCUMENT_QUERY_KEY + ".keyword", "用户2住在2号街区")); // 加".keyword"就是整句匹配
  11.         /*
  12.         * QueryBuilders 有很多查询方式，详情请查看源码
  13.         * termsQuery 相当于 Mysql 的 in
  14.         * searchSourceBuilder.query(QueryBuilders.termsQuery("address.keyword", "用户1住在1号街区"， , "用户2住在2号街区"));
  15.         *
  16.         * 也可以不加 .keyword 进行模糊匹配
  17.         * searchSourceBuilder.query(QueryBuilders.termsQuery("sayWords", "街", "常"));
  18.         *  */
  19.  
  20.         // 拿到索引信息
  21.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  22.  
  23.         // 创建查询请求，将查询对象配置到其中
  24.         SearchRequest searchRequest = new SearchRequest(annotation.index());
  25.         searchRequest.source(searchSourceBuilder);
  26.  
  27.         // 处理查询请求
  28.         SearchResponse response = null;
  29.         try {
  30.             response = restHighLevelClient.search(searchRequest);
  31.             log.info("精确查询的响应体：" + response);
  32.         } catch (IOException e) {
  33.             e.printStackTrace();
  34.         }
  35.  
  36.         // 处理响应
  37.         if (response != null) {
  38.             if (RestStatus.OK.equals(response.status()) && response.getHits().totalHits > 0) {
  39.                 List<UserInfo> result = new ArrayList<>();
  40.                 SearchHits hits = response.getHits();
  41.                 for (SearchHit hit : hits) {
  42.                     // 将JSON转换为对象
  43.                     UserInfo userInfo = JSON.parseObject(hit.getSourceAsString(), UserInfo.class);
  44.                     result.add(userInfo);
  45.                 }
  46.                 log.info("获取查询结果：" + result);
  47.                 return CollectionUtil.isEmpty(result) ? null : result;
  48.             }
  49.         }
  50.         return null;
  51.     }

6.9  匹配查询符合条件的所有数据，并设置分页

  1. /**
  2.      * 匹配查询符合条件的所有数据，并设置分页
  3.      *
  4.      * @return 查询结果
  5.      */
  6.     @Override
  7.     public List<UserInfo> matchAllQuery() {
  8.         // 创建匹配全部的查询条件
  9.         MatchAllQueryBuilder matchAllQueryBuilder = QueryBuilders.matchAllQuery();
  10.         /*
  11.         * 创建匹配筛选的查询条件
  12.         * MatchQueryBuilder matchQueryBuilder = QueryBuilders.matchQuery(TEST_ES_DOCUMENT_QUERY_KEY, "*街区");
  13.         *
  14.         * 创建匹配短句的查询条件
  15.         * MatchPhraseQueryBuilder matchPhraseQueryBuilder = QueryBuilders.matchPhraseQuery(TEST_ES_DOCUMENT_QUERY_KEY, "用户");
  16.         *
  17.         * 创建根据内容匹配多个字段的查询条件
  18.         * MultiMatchQueryBuilder multiMatchQueryBuilder = QueryBuilders.multiMatchQuery("北京", TEST_ES_DOCUMENT_QUERY_KEY, "remark");
  19.         *  */
  20.  
  21.         // 创建查询源构造器
  22.         SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
  23.         searchSourceBuilder.query(matchAllQueryBuilder);
  24.  
  25.         // 设置分页
  26.         searchSourceBuilder.from(0);
  27.         searchSourceBuilder.size(10);
  28.  
  29.         // 设置排序
  30.         searchSourceBuilder.sort("salary", SortOrder.DESC);
  31.  
  32.         // 创建请求，并将查询条件配置到其中
  33.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  34.         SearchRequest request = new SearchRequest(annotation.index());
  35.         request.source(searchSourceBuilder);
  36.  
  37.         // 处理查询请求
  38.         SearchResponse response = null;
  39.         try {
  40.             response = restHighLevelClient.search(request);
  41.             log.info("匹配所有条件查询的响应体：" + response);
  42.         } catch (IOException e) {
  43.             e.printStackTrace();
  44.         }
  45.  
  46.         // 处理响应
  47.         if (response != null) {
  48.             if (RestStatus.OK.equals(response.status()) && response.getHits().totalHits > 0) {
  49.                 List<UserInfo> result = new ArrayList<>();
  50.                 for (SearchHit hit : response.getHits()) {
  51.                     // 将JSON转化为对象
  52.                     UserInfo userInfo = JSON.parseObject(hit.getSourceAsString(), UserInfo.class);
  53.                     result.add(userInfo);
  54.                 }
  55.                 log.info("获取查询结果：" + result);
  56.                 return CollectionUtil.isEmpty(result) ? null : result;
  57.             }
  58.         }
  59.         return null;
  60.     }

6.10 模糊查询 （慎用）

  1. /**
  2.      * 模糊查询
  3.      *
  4.      * 慎用！！
  5.      *
  6.      * @return 查询结果
  7.      */
  8.     @Override
  9.     public List<UserInfo> fuzzyQuery() {
  10.         // 设置筛选条件，并设置模糊性（越大匹配度越低，注意：模糊度没设置合适可能会出现不想要的结果甚至无结果） 慎用！！
  11.         SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
  12.         searchSourceBuilder.query(QueryBuilders.fuzzyQuery(TEST_ES_DOCUMENT_QUERY_KEY, "街区").fuzziness(Fuzziness.ONE));
  13.  
  14.         // 创建请求
  15.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  16.         SearchRequest searchRequest = new SearchRequest(annotation.index());
  17.         searchRequest.source(searchSourceBuilder);
  18.  
  19.         // 处理请求
  20.         SearchResponse response = null;
  21.         try {
  22.             response = restHighLevelClient.search(searchRequest);
  23.             log.info("模糊查询查询的响应体：" + response);
  24.         } catch (IOException e) {
  25.             e.printStackTrace();
  26.         }
  27.  
  28.         // 处理响应
  29.         if (response != null) {
  30.             if (RestStatus.OK.equals(response.status()) && response.getHits().totalHits > 0) {
  31.                 List<UserInfo> result = new ArrayList<>();
  32.                 for (SearchHit hit : response.getHits()) {
  33.                     UserInfo userInfo = JSON.parseObject(hit.getSourceAsString(), UserInfo.class);
  34.                     result.add(userInfo);
  35.                 }
  36.                 log.info("获取查询结果：" + result);
  37.                 return result;
  38.             }
  39.         }
  40.         return null;
  41.     }

6.11 范围查询 

  1. /**
  2.      * 范围查询
  3.      *
  4.      * @return 查询结果
  5.      */
  6.     @Override
  7.     public List<UserInfo> rangeQuery() {
  8.         // 设置查询条件，includeLower（是否包含下边界）、includeUpper（是否包含上边界）
  9.         SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
  10.         searchSourceBuilder.query(QueryBuilders.rangeQuery("salary").gte(500).lte(1000).includeLower(true).includeUpper(true));
  11.         /*
  12.         如果查询的字段是日期类型
  13.         searchSourceBuilder.query(QueryBuilders.rangeQuery("birthday").from("1991-01-01").to("1999-01-01").includeLower(true).includeUpper(true));
  14.         */
  15.  
  16.         // 创建请求
  17.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  18.         SearchRequest request = new SearchRequest(annotation.index());
  19.         request.source(searchSourceBuilder);
  20.  
  21.         // 处理请求
  22.         SearchResponse response = null;
  23.         try {
  24.             response = restHighLevelClient.search(request);
  25.             log.info("范围查询的响应体：" + response);
  26.         } catch (IOException e) {
  27.             e.printStackTrace();
  28.         }
  29.  
  30.         // 处理响应
  31.         if (response != null) {
  32.             if (RestStatus.OK.equals(response.status()) && response.getHits().totalHits > 0) {
  33.                 List<UserInfo> result = new ArrayList<>();
  34.                 for (SearchHit hit : response.getHits()) {
  35.                     UserInfo userInfo = JSON.parseObject(hit.getSourceAsString(), UserInfo.class);
  36.                     result.add(userInfo);
  37.                 }
  38.                 log.info("获取查询结果：" + result);
  39.                 return result;
  40.             }
  41.         }
  42.         return null;
  43.     }

6.12 通配符查询

*：表示多个字符（0个或多个字符）  ?：表示单个字符 

  1. /**
  2.      * 通配符查询（ *：表示多个字符（0个或多个字符）  ?：表示单个字符）
  3.      *
  4.      * @return 查询结果
  5.      */
  6.     @Override
  7.     public List<UserInfo> wildcardQuery() {
  8.         // 创建查询条件
  9.         SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
  10.         searchSourceBuilder.query(QueryBuilders.wildcardQuery(TEST_ES_DOCUMENT_QUERY_KEY + ".keyword", "*街区"));
  11.  
  12.         // 创建请求
  13.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  14.         SearchRequest request = new SearchRequest(annotation.index());
  15.         request.source(searchSourceBuilder);
  16.  
  17.         // 处理请求
  18.         SearchResponse response = null;
  19.         try {
  20.             response = restHighLevelClient.search(request);
  21.             log.info("通配符查询的响应体：" + response);
  22.         } catch (IOException e) {
  23.             e.printStackTrace();
  24.         }
  25.  
  26.         // 处理响应
  27.         if (response != null) {
  28.             if (RestStatus.OK.equals(response.status()) && response.getHits().totalHits > 0) {
  29.                 List<UserInfo> result = new ArrayList<>();
  30.                 for (SearchHit hit : response.getHits()) {
  31.                     UserInfo userInfo = JSON.parseObject(hit.getSourceAsString(), UserInfo.class);
  32.                     result.add(userInfo);
  33.                 }
  34.                 log.info("获取查询结果：" + result);
  35.                 return result;
  36.             }
  37.         }
  38.         return null;
  39.     }

6.13 布尔查询（重点！） 

  1. /**
  2.      * 布尔查询（重点！）
  3.      *
  4.      * @return 查询结果
  5.      */
  6.     @Override
  7.     public List<UserInfo> boolQuery() {
  8.         // 创建bool查询构建器
  9.         BoolQueryBuilder boolQueryBuilder = QueryBuilders.boolQuery();
  10.  
  11.         // 创建查询条件（若有多个条件，就让后面接着加）
  12.         boolQueryBuilder.must(QueryBuilders.termsQuery(TEST_ES_DOCUMENT_QUERY_KEY + ".keyword", "用户2住在2号街区", "用户3住在3号街区", "用户8住在8号街区"))
  13.                 .filter().add(QueryBuilders.rangeQuery("birthday").format("yyyy").gte("1990").lte("1995").includeLower(true).includeUpper(true));
  14.  
  15.         // 创建查询源并将构建器配置其中
  16.         SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
  17.         searchSourceBuilder.query(boolQueryBuilder);
  18.  
  19.         // 创建请求
  20.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  21.         SearchRequest request = new SearchRequest(annotation.index());
  22.         request.source(searchSourceBuilder);
  23.  
  24.         // 处理请求
  25.         SearchResponse response = null;
  26.         try {
  27.             response = restHighLevelClient.search(request);
  28.             log.info("布尔查询的响应体：" + response);
  29.         } catch (IOException e) {
  30.             e.printStackTrace();
  31.         }
  32.  
  33.         // 处理响应
  34.         if (response != null) {
  35.             if (RestStatus.OK.equals(response.status()) && response.getHits().totalHits > 0) {
  36.                 List<UserInfo> result = new ArrayList<>();
  37.                 for (SearchHit hit : response.getHits()) {
  38.                     UserInfo userInfo = JSON.parseObject(hit.getSourceAsString(), UserInfo.class);
  39.                     result.add(userInfo);
  40.                 }
  41.                 log.info("获取查询结果：" + result);
  42.                 return result;
  43.             }
  44.         }
  45.         return null;
  46.     }

6.14 聚合统计查询（重点！） 

  1. /**
  2.      * 聚合统计查询（重点！）
  3.      *
  4.      * @return 查询结果如下:
  5.      * {
  6.      *     "salary_stats": {
  7.      *         "name": "salary_stats",
  8.      *         "count": 26,
  9.      *         "min": 100.0,
  10.      *         "max": 1100.0,
  11.      *         "sum": 12100.0,
  12.      *         "avg": 465.38461538461536,
  13.      *         "type": "stats",
  14.      *         "sumAsString": "12100.0",
  15.      *         "maxAsString": "1100.0",
  16.      *         "avgAsString": "465.38461538461536",
  17.      *         "minAsString": "100.0",
  18.      *         "metaData": null,
  19.      *         "fragment": true
  20.      *     }
  21.      * }
  22.      */
  23.     @Override
  24.     public Object aggregationStats() {
  25.         /*
  26.         声明聚合的类型与字段
  27.             统计数据（可拿到总数、平均数、最大值、最小值等数据）  --      stats("字段_stats").field("字段")
  28.             总数                                               --      count("字段_count").field("字段")
  29.             平均数                                             --       avg("字段_avg").field("字段")
  30.         以此类推...
  31.         */
  32.         AggregationBuilder aggr = AggregationBuilders.stats("salary_stats").field("salary");
  33.  
  34.         // 设置查询条件
  35.         SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
  36.         searchSourceBuilder.aggregation(aggr);
  37.  
  38.         // 设置查询结果不返回，只返回聚合的结果
  39.         searchSourceBuilder.size(0);
  40.  
  41.         // 创建请求
  42.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  43.         SearchRequest request = new SearchRequest(annotation.index());
  44.         request.source(searchSourceBuilder);
  45.  
  46.         // 处理请求
  47.         SearchResponse response = null;
  48.         try {
  49.             response = restHighLevelClient.search(request);
  50.             log.info("聚合统计查询的响应体：" + response);
  51.         } catch (IOException e) {
  52.             e.printStackTrace();
  53.         }
  54.  
  55.  
  56.         // 处理响应
  57.         if (response != null) {
  58.             // 获取响应中的聚合信息
  59.             Aggregations aggregations = response.getAggregations();
  60.  
  61.             if (RestStatus.OK.equals(response.status()) && aggregations != null) {
  62.                 /*
  63.                 解析数据类型
  64.                     ParsedStats             --      聚合信息
  65.                     ParsedValueCount        --      总数
  66.                     ParsedAvg               --      平均数
  67.                 以此类推
  68.                 */
  69.                 ParsedStats stats = aggregations.get("salary_stats");
  70.                 log.info("-------------------------------------------");
  71.                 log.info("聚合信息:");
  72.                 log.info("count：{}", stats.getCount());
  73.                 log.info("avg：{}", stats.getAvg());
  74.                 log.info("max：{}", stats.getMax());
  75.                 log.info("min：{}", stats.getMin());
  76.                 log.info("sum：{}", stats.getSum());
  77.                 log.info("-------------------------------------------");
  78.  
  79.                 return aggregations.getAsMap();
  80.             }
  81.         }
  82.         return null;
  83.     }

6.15 聚合分桶查询（重点！） 

  1. /**
  2.      * 聚合分桶查询（重点！）
  3.      *
  4.      * @return 查询结果： 桶名 与 对应的总数
  5.      */
  6.     @Override
  7.     public Object aggregationBucket() {
  8.         /*
  9.          < 声明聚合的类型与字段 >
  10.          按岁数进行聚合分桶
  11.          TermsAggregationBuilder aggr = AggregationBuilders.terms("age_bucket").field("age");
  12.          按工资范围进行聚合分桶
  13.          AggregationBuilder aggr = AggregationBuilders.range("salary_range_bucket")
  14.                     .field("salary")
  15.                     .addUnboundedTo("低级员工", 3000)
  16.                     .addRange("中级员工", 5000, 9000)
  17.                     .addUnboundedFrom("高级员工", 9000);
  18.           按照时间范围进行分桶
  19.           AggregationBuilder aggr = AggregationBuilders.dateRange("date_range_bucket")
  20.                     .field("birthday")
  21.                     .format("yyyy")
  22.                     .addRange("1985-1990", "1985", "1990")
  23.                     .addRange("1990-1995", "1990", "1995");
  24.            按工资多少进行聚合分桶
  25.            AggregationBuilder aggr = AggregationBuilders.histogram("salary_histogram")
  26.                     .field("salary")
  27.                     .extendedBounds(0, 12000)
  28.                     .interval(3000);
  29.            按出生日期进行分桶
  30.            AggregationBuilder aggr = AggregationBuilders.dateHistogram("birthday_histogram")
  31.                     .field("birthday")
  32.                     .interval(1)
  33.                     .dateHistogramInterval(DateHistogramInterval.YEAR)
  34.                     .format("yyyy");
  35.         */
  36.         TermsAggregationBuilder aggr = AggregationBuilders.terms("age_bucket").field("age");
  37.  
  38.         // 创建查询条件
  39.         SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
  40.         searchSourceBuilder.aggregation(aggr);
  41.         searchSourceBuilder.size(10);
  42.  
  43.         // 创建请求
  44.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  45.         SearchRequest request = new SearchRequest(annotation.index());
  46.         request.source(searchSourceBuilder);
  47.  
  48.         // 处理请求
  49.         SearchResponse response = null;
  50.         try {
  51.             response = restHighLevelClient.search(request);
  52.             log.info("聚合分桶查询的响应体：" + response);
  53.         } catch (IOException e) {
  54.             e.printStackTrace();
  55.         }
  56.  
  57.         // 处理响应
  58.         if (response != null) {
  59.             if (RestStatus.OK.equals(response.status())) {
  60.                 // 获取响应中的聚合信息
  61.                 Aggregations aggregations = response.getAggregations();
  62.  
  63.                 // 分桶
  64.                 Terms byCompanyAggregation  = aggregations.get("age_bucket"); // 不同的聚合类型修改 声明聚合的类型与字段 中AggregationBuilders的不同名称即可
  65.                 List<? extends Terms.Bucket> buckets = byCompanyAggregation.getBuckets();
  66.  
  67.                 // 输出各个桶的内容
  68.                 log.info("-------------------------------------------");
  69.                 log.info("聚合信息:");
  70.                 for (Terms.Bucket bucket : buckets) {
  71.                     log.info("桶名：{} | 总数：{}", bucket.getKeyAsString(), bucket.getDocCount());
  72.                 }
  73.                 log.info("-------------------------------------------");
  74.  
  75.                 return aggregations.getAsMap();
  76.             }
  77.         }
  78.         return null;
  79.     }

6.16 聚合查询场景分析

按岁数分桶、然后统计各个岁数收入最高的用户信息 

  1. /**
  2.      * 聚合查询场景分析
  3.      * （按岁数分桶、然后统计各个岁数收入最高的用户信息）
  4.      *
  5.      * @return 查询结果：
  6.      *  桶名：1
  7.      *  值：{"address":"湖南省常德市","age":1,"birthday":"1991-01-01","createTime":1631498892472,"name":"用户1","remark":"这是第1条文档信息的批量插入","salary":200}
  8.      *
  9.      *  以此类推...
  10.      */
  11.     @Override
  12.     public Object aggregationAnalysis() {
  13.         // 构建聚合参数
  14.         AggregationBuilder testTop = AggregationBuilders.topHits("salary_max_user")
  15.                 .size(1)
  16.                 .sort("salary", SortOrder.DESC);
  17.         AggregationBuilder salaryBucket = AggregationBuilders.terms("salary_bucket")
  18.                 .field("age")
  19.                 .size(10);
  20.         salaryBucket.subAggregation(testTop);
  21.  
  22.         // 创建查询条件
  23.         SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
  24.         searchSourceBuilder.size(0);
  25.         searchSourceBuilder.aggregation(salaryBucket);
  26.  
  27.         // 创建请求
  28.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  29.         SearchRequest request = new SearchRequest(annotation.index());
  30.         request.source(searchSourceBuilder);
  31.  
  32.         // 处理请求
  33.         SearchResponse response = null;
  34.         try {
  35.             response = restHighLevelClient.search(request);
  36.             log.info("聚合查询场景分析的响应体：" + response);
  37.         } catch (IOException e) {
  38.             e.printStackTrace();
  39.         }
  40.  
  41.         // 处理响应
  42.         if (response != null) {
  43.             // 获取响应中的聚合信息
  44.             Aggregations aggregations = response.getAggregations();
  45.  
  46.             if (RestStatus.OK.equals(response.status())) {
  47.                 // 分桶
  48.                 Terms byCompanyAggregation = aggregations.get("salary_bucket");
  49.                 List<? extends Terms.Bucket> buckets = byCompanyAggregation.getBuckets();
  50.                 // 输出各个桶的内容
  51.                 log.info("-------------------------------------------");
  52.                 log.info("聚合信息:");
  53.                 for (Terms.Bucket bucket : buckets) {
  54.                     log.info("桶名：{}", bucket.getKeyAsString());
  55.                     ParsedTopHits topHits = bucket.getAggregations().get("salary_max_user");
  56.                     for (SearchHit hit:topHits.getHits()){
  57.                         log.info(hit.getSourceAsString());
  58.                     }
  59.                 }
  60.                 log.info("-------------------------------------------");
  61.  
  62.                 return aggregations.getAsMap();
  63.             }
  64.         }
  65.         return response;
  66.     }
  67.  
  68.  
  69. }

第六步中所有代码（方便一次性粘贴）

  1. package com.es.example.service.impl;
  2.  
  3. import cn.hutool.core.bean.BeanUtil;
  4. import cn.hutool.core.collection.CollectionUtil;
  5. import com.alibaba.fastjson.JSON;
  6. import com.es.example.annotations.EsDocument;
  7. import com.es.example.entity.UserInfo;
  8. import com.es.example.service.EsIndexOperationService;
  9. import lombok.extern.slf4j.Slf4j;
  10. import org.elasticsearch.action.admin.indices.create.CreateIndexRequest;
  11. import org.elasticsearch.action.admin.indices.create.CreateIndexResponse;
  12. import org.elasticsearch.action.admin.indices.delete.DeleteIndexRequest;
  13. import org.elasticsearch.action.admin.indices.delete.DeleteIndexResponse;
  14. import org.elasticsearch.action.bulk.BulkRequest;
  15. import org.elasticsearch.action.bulk.BulkResponse;
  16. import org.elasticsearch.action.delete.DeleteRequest;
  17. import org.elasticsearch.action.delete.DeleteResponse;
  18. import org.elasticsearch.action.get.GetRequest;
  19. import org.elasticsearch.action.get.GetResponse;
  20. import org.elasticsearch.action.index.IndexRequest;
  21. import org.elasticsearch.action.index.IndexResponse;
  22. import org.elasticsearch.action.search.SearchRequest;
  23. import org.elasticsearch.action.search.SearchResponse;
  24. import org.elasticsearch.action.update.UpdateRequest;
  25. import org.elasticsearch.action.update.UpdateResponse;
  26. import org.elasticsearch.client.RestHighLevelClient;
  27. import org.elasticsearch.common.settings.Settings;
  28. import org.elasticsearch.common.unit.Fuzziness;
  29. import org.elasticsearch.common.xcontent.XContentBuilder;
  30. import org.elasticsearch.common.xcontent.XContentFactory;
  31. import org.elasticsearch.common.xcontent.XContentType;
  32. import org.elasticsearch.index.query.BoolQueryBuilder;
  33. import org.elasticsearch.index.query.MatchAllQueryBuilder;
  34. import org.elasticsearch.index.query.QueryBuilders;
  35. import org.elasticsearch.rest.RestStatus;
  36. import org.elasticsearch.search.SearchHit;
  37. import org.elasticsearch.search.SearchHits;
  38. import org.elasticsearch.search.aggregations.AggregationBuilder;
  39. import org.elasticsearch.search.aggregations.AggregationBuilders;
  40. import org.elasticsearch.search.aggregations.Aggregations;
  41. import org.elasticsearch.search.aggregations.bucket.terms.Terms;
  42. import org.elasticsearch.search.aggregations.bucket.terms.TermsAggregationBuilder;
  43. import org.elasticsearch.search.aggregations.metrics.stats.ParsedStats;
  44. import org.elasticsearch.search.aggregations.metrics.tophits.ParsedTopHits;
  45. import org.elasticsearch.search.builder.SearchSourceBuilder;
  46. import org.elasticsearch.search.sort.SortOrder;
  47. import org.springframework.stereotype.Service;
  48.  
  49. import javax.annotation.Resource;
  50. import java.io.IOException;
  51. import java.util.ArrayList;
  52. import java.util.Date;
  53. import java.util.List;
  54.  
  55. /**
  56.  * Es索引相关操作
  57.  */
  58. @Service
  59. @Slf4j
  60. public class EsIndexOperationServiceImpl implements EsIndexOperationService {
  61.     /**
  62.      * 测试所用  ES文档id
  63.      */
  64.     private static final String TEST_ES_DOCUMENT_ID = "R0Xp3HsByDspl6UWckXA";
  65.  
  66.     /**
  67.      * 查询条件的字段
  68.      */
  69.     private static final String TEST_ES_DOCUMENT_QUERY_KEY = "address";
  70.  
  71.  
  72.     
  73.     @Resource
  74.     private RestHighLevelClient restHighLevelClient;
  75.  
  76.     /**
  77.      * 创建索引
  78.      *
  79.      * @return 创建成功与否
  80.      */
  81.     @Override
  82.     public String createIndex() {
  83.         try {
  84.             // 创建mapping
  85.             XContentBuilder mapping = getCreateIndexMapping();
  86.  
  87.             // 创建索引配置信息
  88.             Settings settings = Settings.builder()
  89.                     .put("index.number_of_shards", 1)
  90.                     .put("index.number_of_replicas", 0)
  91.                     .build();
  92.  
  93.             // 创建索引请求对象，然后设置索引类型（ES 7.0 将不在存在索引类型）和 mapping 与 index 配置
  94.             CreateIndexRequest request = new CreateIndexRequest("test20210910", settings);
  95.             request.mapping("doc", mapping);
  96.  
  97.             // 客户端执行创建索引的请求
  98.             CreateIndexResponse createIndexResponse = restHighLevelClient.indices().create(request);
  99.  
  100.             // 判断是否创建成功
  101.             boolean isCreated = createIndexResponse.isAcknowledged();
  102.             log.info("是否创建成功：[{}]", isCreated);
  103.  
  104.             return isCreated ? "创建成功" : "创建失败";
  105.         } catch (IOException e) {
  106.             e.printStackTrace();
  107.         }
  108.         return null;
  109.     }
  110.  
  111.     /**
  112.      * 获取创建索引的mapping
  113.      *
  114.      * @return mapping
  115.      * @throws IOException IO异常
  116.      */
  117.     private XContentBuilder getCreateIndexMapping() throws IOException {
  118.         // 对比ES原生创建索引Dsl语句，每一个startObject()与endObject()就相当于Dsl语句中的一组大括号 {}
  119.         return XContentFactory.jsonBuilder()
  120.                         .startObject()
  121.                         .field("dynamic", true)
  122.                         .startObject("properties")
  123.                         .startObject("name")
  124.                         .field("type", "text")
  125.                         .startObject("fields")
  126.                         .startObject("keyword")
  127.                         .field("type", "keyword")
  128.                         .endObject()
  129.                         .endObject()
  130.                         .endObject()
  131.  
  132.                         .startObject("address")
  133.                         .field("type", "text")
  134.                         .startObject("fields")
  135.                         .startObject("keyword")
  136.                         .field("type", "keyword")
  137.                         .endObject()
  138.                         .endObject()
  139.                         .endObject()
  140.  
  141.                         .startObject("remark")
  142.                         .field("type", "text")
  143.                         .startObject("fields")
  144.                         .startObject("keyword")
  145.                         .field("type", "keyword")
  146.                         .endObject()
  147.                         .endObject()
  148.                         .endObject()
  149.  
  150.                         .startObject("sayWords")
  151.                         .field("type", "text")
  152.                         .endObject()
  153.  
  154.                         .startObject("age")
  155.                         .field("type", "integer")
  156.                         .endObject()
  157.  
  158.                         .startObject("salary")
  159.                         .field("type", "integer")
  160.                         .endObject()
  161.  
  162.                         .startObject("birthDate")
  163.                         .field("type", "date")
  164.                         .field("format", "yyyy-MM-dd")
  165.                         .endObject()
  166.  
  167.                         .startObject("createTime")
  168.                         .field("type", "date")
  169.                         .endObject()
  170.                         .endObject()
  171.                         .endObject();
  172.     }
  173.  
  174.     /**
  175.      * 删除索引
  176.      *
  177.      * @return 是否删除成功
  178.      */
  179.     @Override
  180.     public String deleteIndex() {
  181.         try {
  182.             // 创建请求
  183.             DeleteIndexRequest request = new DeleteIndexRequest("test20210910");
  184.  
  185.             // 处理请求
  186.             DeleteIndexResponse response = restHighLevelClient.indices().delete(request);
  187.  
  188.             // 拿到结果
  189.             boolean isDelete = response.isAcknowledged();
  190.             log.info("是否删除成功：[{}]", isDelete);
  191.  
  192.             return isDelete ? "删除成功" : "删除失败";
  193.         } catch (IOException e) {
  194.             e.printStackTrace();
  195.         }
  196.         return null;
  197.     }
  198.  
  199.     /**
  200.      * 新增一条文档
  201.      *
  202.      * @return 是否新增成功
  203.      */
  204.     @Override
  205.     public String addADocument() {
  206.         // 创建请求
  207.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class); // 获取注解
  208.         IndexRequest request = new IndexRequest(annotation.index(), annotation.type());
  209.  
  210.         // 创建员工信息
  211.         UserInfo userInfo = UserInfo.builder()
  212.                 .name("王五")
  213.                 .age(9)
  214.                 .salary(1100)
  215.                 .address("天津市")
  216.                 .remark("来自北京市的王先生")
  217.                 .sayWords("啊阿萨飒飒")
  218.                 .createTime(new Date())
  219.                 .birthday("1991-01-01").build();
  220.  
  221.         /*
  222.         将对象转为JSON数组
  223.         不转为JSON格式并且不声明的话会报错java.lang.IllegalArgumentException: The number of object passed must be even but was [1])
  224.         意为 request.source(userInfo) 方法不知道userInfo是什么类型的数据
  225.         */
  226.         byte[] json = JSON.toJSONBytes(userInfo);
  227.  
  228.         // 设置文档内容
  229.         request.source(json, XContentType.JSON); // 声明类型
  230.         try {
  231.             // 执行请求
  232.             IndexResponse response = restHighLevelClient.index(request);
  233.             log.info("新增一条文档的结果状态：[{}]", response.status());
  234.         } catch (IOException e) {
  235.             e.printStackTrace();
  236.         }
  237.         return "新增一条文档成功";
  238.     }
  239.  
  240.     /**
  241.      * 批量新增文档
  242.      *
  243.      * @return 是否新增成功
  244.      */
  245.     @Override
  246.     public String addBulkDocument() {
  247.         // 创建数据集
  248.         List<UserInfo> userInfoList = new ArrayList<>();
  249.         for (int i = 0; i <= 10; i++) {
  250.             UserInfo userInfo = UserInfo.builder()
  251.                     .name("用户" + i)
  252.                     .age(i)
  253.                     .salary(i * 100 + 100)
  254.                     .address("用户" + i + "住在" + i + "号街区")
  255.                     .remark("这是第" + i + "条文档信息的批量插入")
  256.                     .sayWords("大大慢慢那得看" + i)
  257.                     .createTime(new Date())
  258.                     .birthday("199" + i + "-01-01").build();
  259.             userInfoList.add(userInfo);
  260.         }
  261.  
  262.         // 获取注解
  263.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  264.  
  265.         // 创建批量插入的请求
  266.         BulkRequest bulkRequest = new BulkRequest();
  267.         for (UserInfo userInfo : userInfoList) {
  268.             IndexRequest request = new IndexRequest(annotation.index(), annotation.type());
  269.             /*
  270.             * 将对象转为JSON数组
  271.               不转为JSON格式并且不声明的话会报错java.lang.IllegalArgumentException: The number of object passed must be even but was [1])
  272.               意为 request.source(userInfo) 方法不知道userInfo是什么类型的数据
  273.             *  */
  274.             byte[] json = JSON.toJSONBytes(userInfo);
  275.             request.source(json, XContentType.JSON); // 声明类型
  276.             bulkRequest.add(request);
  277.         }
  278.  
  279.         // 执行批量请求
  280.         BulkResponse response = null;
  281.         try {
  282.             response = restHighLevelClient.bulk(bulkRequest);
  283.             log.info("新增一条文档的结果状态：[{}]", response.status().getStatus());
  284.         } catch (IOException e) {
  285.             e.printStackTrace();
  286.         }
  287.         return response != null && response.status().getStatus() == 200 ? "批量新增文档成功" : "批量新增文档失败";
  288.     }
  289.  
  290.     /**
  291.      * 更新文档
  292.      *
  293.      * @return 是否更新成功
  294.      */
  295.     @Override
  296.     public String updateDocument() {
  297.         // 设置更新数据
  298.         UserInfo update = UserInfo.builder().address("湖南省常德市").build();
  299.         byte[] json = JSON.toJSONBytes(update);
  300.  
  301.         // 创建请求
  302.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  303.         UpdateRequest request = new UpdateRequest(annotation.index(), annotation.type(), TEST_ES_DOCUMENT_ID);
  304.         request.doc(json, XContentType.JSON);
  305.  
  306.         // 处理请求
  307.         UpdateResponse response = null;
  308.         try {
  309.             response = restHighLevelClient.update(request);
  310.             log.info("更新一条文档的结果状态：[{}]", response.status().getStatus());
  311.         } catch (IOException e) {
  312.             e.printStackTrace();
  313.         }
  314.         return response != null && response.status().getStatus() == 200 ? "更新成功" : "更新失败";
  315.     }
  316.  
  317.     /**
  318.      * 删除文档
  319.      *
  320.      * @return 是否删除成功
  321.      */
  322.     @Override
  323.     public String deleteDocument() {
  324.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  325.         DeleteRequest request = new DeleteRequest(annotation.index(), annotation.type(), TEST_ES_DOCUMENT_ID);
  326.  
  327.         DeleteResponse response = null;
  328.         try {
  329.             response = restHighLevelClient.delete(request);
  330.             log.info("删除一条文档的结果状态：[{}]", response.status().getStatus());
  331.         } catch (IOException e) {
  332.             e.printStackTrace();
  333.         }
  334.         return response != null && response.status().getStatus() == 200 ? "删除成功" : "删除失败";
  335.     }
  336.  
  337.  
  338.     /* >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 以下为查询操作示例 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< */
  339.  
  340.     /**
  341.      * 根据id获取文档
  342.      *
  343.      * @return 文档结果
  344.      */
  345.     @Override
  346.     public UserInfo getDocument() {
  347.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  348.         GetRequest request = new GetRequest(annotation.index(), annotation.type(), TEST_ES_DOCUMENT_ID);
  349.         GetResponse response = null;
  350.         try {
  351.             response = restHighLevelClient.get(request);
  352.             log.info("根据id查询的响应体：" + response);
  353.         } catch (IOException e) {
  354.             e.printStackTrace();
  355.         }
  356.         if (response != null) {
  357.             UserInfo userInfo = JSON.parseObject(response.getSourceAsBytes(), UserInfo.class);
  358.             log.info("获取查询结果：" + userInfo);
  359.             return BeanUtil.isEmpty(userInfo) ? null : userInfo;
  360.         }
  361.         return null;
  362.     }
  363.  
  364.     /**
  365.      * 精确查询（查询条件不会进行分词，但是查询内容可能会分词，导致查询不到）
  366.      *
  367.      * @return 查询结果
  368.      */
  369.     @Override
  370.     public List<UserInfo> termQuery() {
  371.         // 构建查询条件（注意：termQuery 支持多种格式查询，如 boolean、int、double、string 等，这里使用的是 string 的查询）
  372.         SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
  373.         searchSourceBuilder.query(QueryBuilders.termQuery(TEST_ES_DOCUMENT_QUERY_KEY + ".keyword", "用户2住在2号街区")); // 加".keyword"就是整句匹配
  374.         /*
  375.         * QueryBuilders 有很多查询方式，详情请查看源码
  376.         * termsQuery 相当于 Mysql 的 in
  377.         * searchSourceBuilder.query(QueryBuilders.termsQuery("address.keyword", "用户1住在1号街区"， , "用户2住在2号街区"));
  378.         *
  379.         * 也可以不加 .keyword 进行模糊匹配
  380.         * searchSourceBuilder.query(QueryBuilders.termsQuery("sayWords", "街", "常"));
  381.         *  */
  382.  
  383.         // 拿到索引信息
  384.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  385.  
  386.         // 创建查询请求，将查询对象配置到其中
  387.         SearchRequest searchRequest = new SearchRequest(annotation.index());
  388.         searchRequest.source(searchSourceBuilder);
  389.  
  390.         // 处理查询请求
  391.         SearchResponse response = null;
  392.         try {
  393.             response = restHighLevelClient.search(searchRequest);
  394.             log.info("精确查询的响应体：" + response);
  395.         } catch (IOException e) {
  396.             e.printStackTrace();
  397.         }
  398.  
  399.         // 处理响应
  400.         if (response != null) {
  401.             if (RestStatus.OK.equals(response.status()) && response.getHits().totalHits > 0) {
  402.                 List<UserInfo> result = new ArrayList<>();
  403.                 SearchHits hits = response.getHits();
  404.                 for (SearchHit hit : hits) {
  405.                     // 将JSON转换为对象
  406.                     UserInfo userInfo = JSON.parseObject(hit.getSourceAsString(), UserInfo.class);
  407.                     result.add(userInfo);
  408.                 }
  409.                 log.info("获取查询结果：" + result);
  410.                 return CollectionUtil.isEmpty(result) ? null : result;
  411.             }
  412.         }
  413.         return null;
  414.     }
  415.  
  416.     /**
  417.      * 匹配查询符合条件的所有数据，并设置分页
  418.      *
  419.      * @return 查询结果
  420.      */
  421.     @Override
  422.     public List<UserInfo> matchAllQuery() {
  423.         // 创建匹配全部的查询条件
  424.         MatchAllQueryBuilder matchAllQueryBuilder = QueryBuilders.matchAllQuery();
  425.         /*
  426.         * 创建匹配筛选的查询条件
  427.         * MatchQueryBuilder matchQueryBuilder = QueryBuilders.matchQuery(TEST_ES_DOCUMENT_QUERY_KEY, "*街区");
  428.         *
  429.         * 创建匹配短句的查询条件
  430.         * MatchPhraseQueryBuilder matchPhraseQueryBuilder = QueryBuilders.matchPhraseQuery(TEST_ES_DOCUMENT_QUERY_KEY, "用户");
  431.         *
  432.         * 创建根据内容匹配多个字段的查询条件
  433.         * MultiMatchQueryBuilder multiMatchQueryBuilder = QueryBuilders.multiMatchQuery("北京", TEST_ES_DOCUMENT_QUERY_KEY, "remark");
  434.         *  */
  435.  
  436.         // 创建查询源构造器
  437.         SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
  438.         searchSourceBuilder.query(matchAllQueryBuilder);
  439.  
  440.         // 设置分页
  441.         searchSourceBuilder.from(0);
  442.         searchSourceBuilder.size(10);
  443.  
  444.         // 设置排序
  445.         searchSourceBuilder.sort("salary", SortOrder.DESC);
  446.  
  447.         // 创建请求，并将查询条件配置到其中
  448.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  449.         SearchRequest request = new SearchRequest(annotation.index());
  450.         request.source(searchSourceBuilder);
  451.  
  452.         // 处理查询请求
  453.         SearchResponse response = null;
  454.         try {
  455.             response = restHighLevelClient.search(request);
  456.             log.info("匹配所有条件查询的响应体：" + response);
  457.         } catch (IOException e) {
  458.             e.printStackTrace();
  459.         }
  460.  
  461.         // 处理响应
  462.         if (response != null) {
  463.             if (RestStatus.OK.equals(response.status()) && response.getHits().totalHits > 0) {
  464.                 List<UserInfo> result = new ArrayList<>();
  465.                 for (SearchHit hit : response.getHits()) {
  466.                     // 将JSON转化为对象
  467.                     UserInfo userInfo = JSON.parseObject(hit.getSourceAsString(), UserInfo.class);
  468.                     result.add(userInfo);
  469.                 }
  470.                 log.info("获取查询结果：" + result);
  471.                 return CollectionUtil.isEmpty(result) ? null : result;
  472.             }
  473.         }
  474.         return null;
  475.     }
  476.  
  477.     /**
  478.      * 模糊查询
  479.      *
  480.      * 慎用！！
  481.      *
  482.      * @return 查询结果
  483.      */
  484.     @Override
  485.     public List<UserInfo> fuzzyQuery() {
  486.         // 设置筛选条件，并设置模糊性（越大匹配度越低，注意：模糊度没设置合适可能会出现不想要的结果甚至无结果） 慎用！！
  487.         SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
  488.         searchSourceBuilder.query(QueryBuilders.fuzzyQuery(TEST_ES_DOCUMENT_QUERY_KEY, "街区").fuzziness(Fuzziness.ONE));
  489.  
  490.         // 创建请求
  491.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  492.         SearchRequest searchRequest = new SearchRequest(annotation.index());
  493.         searchRequest.source(searchSourceBuilder);
  494.  
  495.         // 处理请求
  496.         SearchResponse response = null;
  497.         try {
  498.             response = restHighLevelClient.search(searchRequest);
  499.             log.info("模糊查询查询的响应体：" + response);
  500.         } catch (IOException e) {
  501.             e.printStackTrace();
  502.         }
  503.  
  504.         // 处理响应
  505.         if (response != null) {
  506.             if (RestStatus.OK.equals(response.status()) && response.getHits().totalHits > 0) {
  507.                 List<UserInfo> result = new ArrayList<>();
  508.                 for (SearchHit hit : response.getHits()) {
  509.                     UserInfo userInfo = JSON.parseObject(hit.getSourceAsString(), UserInfo.class);
  510.                     result.add(userInfo);
  511.                 }
  512.                 log.info("获取查询结果：" + result);
  513.                 return result;
  514.             }
  515.         }
  516.         return null;
  517.     }
  518.  
  519.     /**
  520.      * 范围查询
  521.      *
  522.      * @return 查询结果
  523.      */
  524.     @Override
  525.     public List<UserInfo> rangeQuery() {
  526.         // 设置查询条件，includeLower（是否包含下边界）、includeUpper（是否包含上边界）
  527.         SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
  528.         searchSourceBuilder.query(QueryBuilders.rangeQuery("salary").gte(500).lte(1000).includeLower(true).includeUpper(true));
  529.         /*
  530.         如果查询的字段是日期类型
  531.         searchSourceBuilder.query(QueryBuilders.rangeQuery("birthday").from("1991-01-01").to("1999-01-01").includeLower(true).includeUpper(true));
  532.         */
  533.  
  534.         // 创建请求
  535.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  536.         SearchRequest request = new SearchRequest(annotation.index());
  537.         request.source(searchSourceBuilder);
  538.  
  539.         // 处理请求
  540.         SearchResponse response = null;
  541.         try {
  542.             response = restHighLevelClient.search(request);
  543.             log.info("范围查询的响应体：" + response);
  544.         } catch (IOException e) {
  545.             e.printStackTrace();
  546.         }
  547.  
  548.         // 处理响应
  549.         if (response != null) {
  550.             if (RestStatus.OK.equals(response.status()) && response.getHits().totalHits > 0) {
  551.                 List<UserInfo> result = new ArrayList<>();
  552.                 for (SearchHit hit : response.getHits()) {
  553.                     UserInfo userInfo = JSON.parseObject(hit.getSourceAsString(), UserInfo.class);
  554.                     result.add(userInfo);
  555.                 }
  556.                 log.info("获取查询结果：" + result);
  557.                 return result;
  558.             }
  559.         }
  560.         return null;
  561.     }
  562.  
  563.     /**
  564.      * 通配符查询（ *：表示多个字符（0个或多个字符）  ?：表示单个字符）
  565.      *
  566.      * @return 查询结果
  567.      */
  568.     @Override
  569.     public List<UserInfo> wildcardQuery() {
  570.         // 创建查询条件
  571.         SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
  572.         searchSourceBuilder.query(QueryBuilders.wildcardQuery(TEST_ES_DOCUMENT_QUERY_KEY + ".keyword", "*街区"));
  573.  
  574.         // 创建请求
  575.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  576.         SearchRequest request = new SearchRequest(annotation.index());
  577.         request.source(searchSourceBuilder);
  578.  
  579.         // 处理请求
  580.         SearchResponse response = null;
  581.         try {
  582.             response = restHighLevelClient.search(request);
  583.             log.info("通配符查询的响应体：" + response);
  584.         } catch (IOException e) {
  585.             e.printStackTrace();
  586.         }
  587.  
  588.         // 处理响应
  589.         if (response != null) {
  590.             if (RestStatus.OK.equals(response.status()) && response.getHits().totalHits > 0) {
  591.                 List<UserInfo> result = new ArrayList<>();
  592.                 for (SearchHit hit : response.getHits()) {
  593.                     UserInfo userInfo = JSON.parseObject(hit.getSourceAsString(), UserInfo.class);
  594.                     result.add(userInfo);
  595.                 }
  596.                 log.info("获取查询结果：" + result);
  597.                 return result;
  598.             }
  599.         }
  600.         return null;
  601.     }
  602.  
  603.     /**
  604.      * 布尔查询（重点！）
  605.      *
  606.      * @return 查询结果
  607.      */
  608.     @Override
  609.     public List<UserInfo> boolQuery() {
  610.         // 创建bool查询构建器
  611.         BoolQueryBuilder boolQueryBuilder = QueryBuilders.boolQuery();
  612.  
  613.         // 创建查询条件（若有多个条件，就让后面接着加）
  614.         boolQueryBuilder.must(QueryBuilders.termsQuery(TEST_ES_DOCUMENT_QUERY_KEY + ".keyword", "用户2住在2号街区", "用户3住在3号街区", "用户8住在8号街区"))
  615.                 .filter().add(QueryBuilders.rangeQuery("birthday").format("yyyy").gte("1990").lte("1995").includeLower(true).includeUpper(true));
  616.  
  617.         // 创建查询源并将构建器配置其中
  618.         SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
  619.         searchSourceBuilder.query(boolQueryBuilder);
  620.  
  621.         // 创建请求
  622.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  623.         SearchRequest request = new SearchRequest(annotation.index());
  624.         request.source(searchSourceBuilder);
  625.  
  626.         // 处理请求
  627.         SearchResponse response = null;
  628.         try {
  629.             response = restHighLevelClient.search(request);
  630.             log.info("布尔查询的响应体：" + response);
  631.         } catch (IOException e) {
  632.             e.printStackTrace();
  633.         }
  634.  
  635.         // 处理响应
  636.         if (response != null) {
  637.             if (RestStatus.OK.equals(response.status()) && response.getHits().totalHits > 0) {
  638.                 List<UserInfo> result = new ArrayList<>();
  639.                 for (SearchHit hit : response.getHits()) {
  640.                     UserInfo userInfo = JSON.parseObject(hit.getSourceAsString(), UserInfo.class);
  641.                     result.add(userInfo);
  642.                 }
  643.                 log.info("获取查询结果：" + result);
  644.                 return result;
  645.             }
  646.         }
  647.         return null;
  648.     }
  649.  
  650.     /**
  651.      * 聚合统计查询（重点！）
  652.      *
  653.      * @return 查询结果如下:
  654.      * {
  655.      *     "salary_stats": {
  656.      *         "name": "salary_stats",
  657.      *         "count": 26,
  658.      *         "min": 100.0,
  659.      *         "max": 1100.0,
  660.      *         "sum": 12100.0,
  661.      *         "avg": 465.38461538461536,
  662.      *         "type": "stats",
  663.      *         "sumAsString": "12100.0",
  664.      *         "maxAsString": "1100.0",
  665.      *         "avgAsString": "465.38461538461536",
  666.      *         "minAsString": "100.0",
  667.      *         "metaData": null,
  668.      *         "fragment": true
  669.      *     }
  670.      * }
  671.      */
  672.     @Override
  673.     public Object aggregationStats() {
  674.         /*
  675.         声明聚合的类型与字段
  676.             统计数据（可拿到总数、平均数、最大值、最小值等数据）  --      stats("字段_stats").field("字段")
  677.             总数                                               --      count("字段_count").field("字段")
  678.             平均数                                             --       avg("字段_avg").field("字段")
  679.         以此类推...
  680.         */
  681.         AggregationBuilder aggr = AggregationBuilders.stats("salary_stats").field("salary");
  682.  
  683.         // 设置查询条件
  684.         SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
  685.         searchSourceBuilder.aggregation(aggr);
  686.  
  687.         // 设置查询结果不返回，只返回聚合的结果
  688.         searchSourceBuilder.size(0);
  689.  
  690.         // 创建请求
  691.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  692.         SearchRequest request = new SearchRequest(annotation.index());
  693.         request.source(searchSourceBuilder);
  694.  
  695.         // 处理请求
  696.         SearchResponse response = null;
  697.         try {
  698.             response = restHighLevelClient.search(request);
  699.             log.info("聚合统计查询的响应体：" + response);
  700.         } catch (IOException e) {
  701.             e.printStackTrace();
  702.         }
  703.  
  704.  
  705.         // 处理响应
  706.         if (response != null) {
  707.             // 获取响应中的聚合信息
  708.             Aggregations aggregations = response.getAggregations();
  709.  
  710.             if (RestStatus.OK.equals(response.status()) && aggregations != null) {
  711.                 /*
  712.                 解析数据类型
  713.                     ParsedStats             --      聚合信息
  714.                     ParsedValueCount        --      总数
  715.                     ParsedAvg               --      平均数
  716.                 以此类推
  717.                 */
  718.                 ParsedStats stats = aggregations.get("salary_stats");
  719.                 log.info("-------------------------------------------");
  720.                 log.info("聚合信息:");
  721.                 log.info("count：{}", stats.getCount());
  722.                 log.info("avg：{}", stats.getAvg());
  723.                 log.info("max：{}", stats.getMax());
  724.                 log.info("min：{}", stats.getMin());
  725.                 log.info("sum：{}", stats.getSum());
  726.                 log.info("-------------------------------------------");
  727.  
  728.                 return aggregations.getAsMap();
  729.             }
  730.         }
  731.         return null;
  732.     }
  733.  
  734.     /**
  735.      * 聚合分桶查询（重点！）
  736.      *
  737.      * @return 查询结果： 桶名 与 对应的总数
  738.      */
  739.     @Override
  740.     public Object aggregationBucket() {
  741.         /*
  742.          < 声明聚合的类型与字段 >
  743.          按岁数进行聚合分桶
  744.          TermsAggregationBuilder aggr = AggregationBuilders.terms("age_bucket").field("age");
  745.          按工资范围进行聚合分桶
  746.          AggregationBuilder aggr = AggregationBuilders.range("salary_range_bucket")
  747.                     .field("salary")
  748.                     .addUnboundedTo("低级员工", 3000)
  749.                     .addRange("中级员工", 5000, 9000)
  750.                     .addUnboundedFrom("高级员工", 9000);
  751.           按照时间范围进行分桶
  752.           AggregationBuilder aggr = AggregationBuilders.dateRange("date_range_bucket")
  753.                     .field("birthday")
  754.                     .format("yyyy")
  755.                     .addRange("1985-1990", "1985", "1990")
  756.                     .addRange("1990-1995", "1990", "1995");
  757.            按工资多少进行聚合分桶
  758.            AggregationBuilder aggr = AggregationBuilders.histogram("salary_histogram")
  759.                     .field("salary")
  760.                     .extendedBounds(0, 12000)
  761.                     .interval(3000);
  762.            按出生日期进行分桶
  763.            AggregationBuilder aggr = AggregationBuilders.dateHistogram("birthday_histogram")
  764.                     .field("birthday")
  765.                     .interval(1)
  766.                     .dateHistogramInterval(DateHistogramInterval.YEAR)
  767.                     .format("yyyy");
  768.         */
  769.         TermsAggregationBuilder aggr = AggregationBuilders.terms("age_bucket").field("age");
  770.  
  771.         // 创建查询条件
  772.         SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
  773.         searchSourceBuilder.aggregation(aggr);
  774.         searchSourceBuilder.size(10);
  775.  
  776.         // 创建请求
  777.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  778.         SearchRequest request = new SearchRequest(annotation.index());
  779.         request.source(searchSourceBuilder);
  780.  
  781.         // 处理请求
  782.         SearchResponse response = null;
  783.         try {
  784.             response = restHighLevelClient.search(request);
  785.             log.info("聚合分桶查询的响应体：" + response);
  786.         } catch (IOException e) {
  787.             e.printStackTrace();
  788.         }
  789.  
  790.         // 处理响应
  791.         if (response != null) {
  792.             if (RestStatus.OK.equals(response.status())) {
  793.                 // 获取响应中的聚合信息
  794.                 Aggregations aggregations = response.getAggregations();
  795.  
  796.                 // 分桶
  797.                 Terms byCompanyAggregation  = aggregations.get("age_bucket"); // 不同的聚合类型修改 声明聚合的类型与字段 中AggregationBuilders的不同名称即可
  798.                 List<? extends Terms.Bucket> buckets = byCompanyAggregation.getBuckets();
  799.  
  800.                 // 输出各个桶的内容
  801.                 log.info("-------------------------------------------");
  802.                 log.info("聚合信息:");
  803.                 for (Terms.Bucket bucket : buckets) {
  804.                     log.info("桶名：{} | 总数：{}", bucket.getKeyAsString(), bucket.getDocCount());
  805.                 }
  806.                 log.info("-------------------------------------------");
  807.  
  808.                 return aggregations.getAsMap();
  809.             }
  810.         }
  811.         return null;
  812.     }
  813.  
  814.     /**
  815.      * 聚合查询场景分析
  816.      * （按岁数分桶、然后统计各个岁数收入最高的用户信息）
  817.      *
  818.      * @return 查询结果：
  819.      *  桶名：1
  820.      *  值：{"address":"湖南省常德市","age":1,"birthday":"1991-01-01","createTime":1631498892472,"name":"用户1","remark":"这是第1条文档信息的批量插入","salary":200}
  821.      *
  822.      *  以此类推...
  823.      */
  824.     @Override
  825.     public Object aggregationAnalysis() {
  826.         // 构建聚合参数
  827.         AggregationBuilder testTop = AggregationBuilders.topHits("salary_max_user")
  828.                 .size(1)
  829.                 .sort("salary", SortOrder.DESC);
  830.         AggregationBuilder salaryBucket = AggregationBuilders.terms("salary_bucket")
  831.                 .field("age")
  832.                 .size(10);
  833.         salaryBucket.subAggregation(testTop);
  834.  
  835.         // 创建查询条件
  836.         SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
  837.         searchSourceBuilder.size(0);
  838.         searchSourceBuilder.aggregation(salaryBucket);
  839.  
  840.         // 创建请求
  841.         EsDocument annotation = UserInfo.class.getAnnotation(EsDocument.class);
  842.         SearchRequest request = new SearchRequest(annotation.index());
  843.         request.source(searchSourceBuilder);
  844.  
  845.         // 处理请求
  846.         SearchResponse response = null;
  847.         try {
  848.             response = restHighLevelClient.search(request);
  849.             log.info("聚合查询场景分析的响应体：" + response);
  850.         } catch (IOException e) {
  851.             e.printStackTrace();
  852.         }
  853.  
  854.         // 处理响应
  855.         if (response != null) {
  856.             // 获取响应中的聚合信息
  857.             Aggregations aggregations = response.getAggregations();
  858.  
  859.             if (RestStatus.OK.equals(response.status())) {
  860.                 // 分桶
  861.                 Terms byCompanyAggregation = aggregations.get("salary_bucket");
  862.                 List<? extends Terms.Bucket> buckets = byCompanyAggregation.getBuckets();
  863.                 // 输出各个桶的内容
  864.                 log.info("-------------------------------------------");
  865.                 log.info("聚合信息:");
  866.                 for (Terms.Bucket bucket : buckets) {
  867.                     log.info("桶名：{}", bucket.getKeyAsString());
  868.                     ParsedTopHits topHits = bucket.getAggregations().get("salary_max_user");
  869.                     for (SearchHit hit:topHits.getHits()){
  870.                         log.info(hit.getSourceAsString());
  871.                     }
  872.                 }
  873.                 log.info("-------------------------------------------");
  874.  
  875.                 return aggregations.getAsMap();
  876.             }
  877.         }
  878.         return response;
  879.     }
  880.  
  881.  
  882. }

说明：

        本文章是在学习了 <全栈开发者社区> 与 <狂神说> 的Es相关讲解后的实践与补充，想学习更加完整的知识可去膜拜大神！！

声明：本文内容由网友自发贡献，不代表【wpsshop博客】立场，版权归原作者所有，本站不承担相应法律责任。如您发现有侵权的内容，请联系我们。转载请注明出处：https://www.wpsshop.cn/w/AllinToyou/article/detail/68395
推荐阅读
相关标签

Copyright © 2003-2013 www.wpsshop.cn 版权所有，并保留所有权利。