devbox
羊村懒王
这个屌丝很懒，什么也没留下！
关注作者
热门标签
热门文章
当前位置:   article > 正文

【Elasticsearch学习笔记五】es常用的JAVA API、es整合SpringBoot项目中使用、利用JAVA代码操作es、RestHighLevelClient客户端对象_es java api sortoptions

作者：羊村懒王 | 2024-02-08 10:31:28

赞

踩

es java api sortoptions

目录

一、Maven项目集成Easticsearch

1）客户端对象

2）索引操作

3）文档操作

4）高级查询

二、springboot项目集成Spring Data操作Elasticsearch

1）pom文件

2）yaml

3）数据实体类

4）配置类

5）Dao数据访问对象

6）索引操作

7）文档操作

8）文档搜索

三、springboot项目集成bboss操作elasticsearch

1）pom文件和配置

2）getConfigRestClientUtil和getRestClientUtil区别

3）创建索引

4）删除索引

5）判断索引是否存在

6）判断索引类型是否存在

7）添加单个文档

8）批量添加文档

9）查询单个文档

一、Maven项目集成Easticsearch

        Elasticsearch软件是由 Java 语言开发的，所以也可以通过 Java API 的方式对 Elasticsearch服务进行访问。  修改pom 文件，增加 Maven 依赖关系。

  1. <properties>
  2.     <java.version>1.8</java.version>
  3.     <elasticsearch.version>7.4.2</elasticsearch.version>
  4. </properties>
  5.  
  6. <dependency>
  7.     <groupId>org.elasticsearch.client</groupId>
  8.     <artifactId>elasticsearch-rest-high-level-client</artifactId>
  9.     <version>7.4.2</version>
  10. </dependency>

1）客户端对象

        创建类，代码中创建 Elasticsearch 客户端对象因为早期版本的客户端对象已经不再推荐使用，且在未来版本中会被删除，所以这里我们采用高级 REST 客户端对象；

  1.     public static void main(String[] args) throws IOException {
  2.         // 创建客户端对象
  3.         RestHighLevelClient client = new RestHighLevelClient(
  4.                 RestClient.builder(new HttpHost("127.0.0.1", 9200, "http"))
  5.         );
  6.  
  7.         // 关闭客户端连接
  8.         client.close();
  9.     }

2）索引操作

        ES服务器正常启动后，可以通过 Java API 客户端对象对 ES 索引进行操作 ；

  1. public class EsIndex {
  2.  
  3.     public static void main(String[] args) throws IOException {
  4.  
  5.         // 创建客户端对象
  6.         RestHighLevelClient client = new RestHighLevelClient(
  7.                 RestClient.builder(new HttpHost("127.0.0.1", 9200, "http"))
  8.         );
  9.  
  10.         // 关闭客户端连接
  11.         client.close();
  12.     }
  13.  
  14.     // 创建索引
  15.     public static void createIndex(RestHighLevelClient client) throws IOException {
  16.         // 创建索引 - 请求对象
  17.         CreateIndexRequest request = new CreateIndexRequest("user");
  18.         // 发送请求，获取响应
  19.         CreateIndexResponse response = client.indices().create(request, RequestOptions.DEFAULT);
  20.         boolean acknowledged = response.isAcknowledged();
  21.         // 响应状态
  22.         System.out.println("操作状态 = " + acknowledged);
  23.     }
  24.  
  25.     // 查看索引
  26.     public static void getIndex(RestHighLevelClient client) throws IOException {
  27.         // 查询索引 - 请求对象
  28.         GetIndexRequest request = new GetIndexRequest("user");
  29.         // 发送请求，获取响应
  30.         GetIndexResponse response = client.indices().get(request, RequestOptions.DEFAULT);
  31.         System.out.println("aliases: " + response.getAliases());
  32.         System.out.println("mappings: " + response.getMappings());
  33.         System.out.println("settings: " + response.getSettings());
  34.     }
  35.  
  36.     // 删除索引
  37.     public static void deleteIndex(RestHighLevelClient client) throws IOException {
  38.         // 删除索引 - 请求对象
  39.         DeleteIndexRequest request = new DeleteIndexRequest("user");
  40.         // 发送请求，获取响应
  41.         AcknowledgedResponse response = client.indices().delete(request, RequestOptions.DEFAULT);
  42.         // 操作结果
  43.         System.out.println("操作结果: " + response.isAcknowledged());
  44.     }
  45. }

3）文档操作

  1. public class EsDoc {
  2.  
  3.     public static void main(String[] args) throws IOException {
  4.         // 创建客户端对象
  5.         RestHighLevelClient client = new RestHighLevelClient(
  6.                 RestClient.builder(new HttpHost("127.0.0.1", 9200, "http"))
  7.         );
  8.  
  9.         // 关闭客户端连接
  10.         client.close();
  11.     }
  12.  
  13.     // 创建文档
  14.     public static void createDoc(RestHighLevelClient client) throws IOException {
  15.         // 新增文档 - 请求对象
  16.         IndexRequest request = new IndexRequest();
  17.         // 设置索引及唯一性标识
  18.         request.index("user").id("1001");
  19.         // 创建数据对象
  20.         User user = new User();
  21.         user.setAge(26);
  22.         user.setSex("男");
  23.         user.setName("jak");
  24.         ObjectMapper objectMapper = new ObjectMapper();
  25.         String productJson = objectMapper.writeValueAsString(user);
  26.         // 添加文档数据, 数据格式为Json格式
  27.         request.source(productJson, XContentType.JSON);
  28.         // 客户端发送请求，获取响应对象
  29.         IndexResponse response = client.index(request, RequestOptions.DEFAULT);
  30.         // 打印结果信息
  31.         System.out.println("_index: " + response.getIndex());
  32.         System.out.println("id: " + response.getId());
  33.         System.out.println("_result: " + response.getResult());
  34.     }
  35.  
  36.     // 修改文档
  37.     public static void updateDoc(RestHighLevelClient client) throws IOException {
  38.         // 修改文档 - 请求对象
  39.         UpdateRequest request = new UpdateRequest();
  40.         // 配置修改参数
  41.         request.index("user").id("1001");
  42.         // 设置请求体，对数据进行修改
  43.         request.doc(XContentType.JSON, "sex", "女");
  44.         // 客户端发送请求，获取响应对象
  45.         UpdateResponse response = client.update(request, RequestOptions.DEFAULT);
  46.         System.out.println("_index: " + response.getIndex());
  47.         System.out.println("_id: " + response.getId());
  48.         System.out.println("_result: " + response.getResult());
  49.     }
  50.  
  51.     // 查询文档
  52.     public static void getDoc(RestHighLevelClient client) throws IOException {
  53.         // 创建请求对象
  54.         GetRequest request = new GetRequest().index("user").id("1001");
  55.         // 客户端发送请求，获取响应对象
  56.         GetResponse response = client.get(request, RequestOptions.DEFAULT);
  57.         // 打印结果信息
  58.         System.out.println("_index: " + response.getIndex());
  59.         System.out.println("_type: " + response.getType());
  60.         System.out.println("_id: " + response.getId());
  61.         System.out.println("source: " + response.getSourceAsString());
  62.     }
  63.  
  64.     // 删除文档
  65.     public static void deleteDoc(RestHighLevelClient client) throws IOException {
  66.         // 创建请求对象
  67.         DeleteRequest request = new DeleteRequest().index("user").id("1");
  68.         // 客户端发送请求，获取响应对象
  69.         DeleteResponse response = client.delete(request, RequestOptions.DEFAULT);
  70.         // 打印信息
  71.         System.out.println(response.toString());
  72.     }
  73.  
  74.     // 批量新增
  75.     public static void bulkCreateDoc(RestHighLevelClient client) throws IOException {
  76.         // 创建批量新增请求对象
  77.         BulkRequest request = new BulkRequest();
  78.         request.add(new IndexRequest().index("user").id("1001").source(XContentType.JSON, "name", "zhangsan"));
  79.         request.add(new IndexRequest().index("user").id("1002").source(XContentType.JSON, "name", "lisi"));
  80.         request.add(new IndexRequest().index("user").id("1003").source(XContentType.JSON, "name", "wangwu"));
  81.         // 客户端发送请求，获取响应对象
  82.         BulkResponse responses = client.bulk(request, RequestOptions.DEFAULT);
  83.         // 打印结果信息
  84.         System.out.println("took: " + responses.getTook());
  85.         System.out.println("items: " + Arrays.toString(responses.getItems()));
  86.     }
  87.  
  88.     // 批量删除
  89.     public static void bulkDeleteDoc(RestHighLevelClient client) throws IOException {
  90.         // 创建批量删除请求对象
  91.         BulkRequest request = new BulkRequest();
  92.         request.add(new DeleteRequest().index("user").id("1001"));
  93.         request.add(new DeleteRequest().index("user").id("1002"));
  94.         request.add(new DeleteRequest().index("user").id("1003"));
  95.         // 客户端发送请求，获取响应对象
  96.         BulkResponse responses = client.bulk(request, RequestOptions.DEFAULT);
  97.         // 打印结果信息
  98.         System.out.println("took: " + responses.getTook());
  99.         System.out.println("items: " + Arrays.toString(responses.getItems()));
  100.  
  101.     }
  102. }

4）高级查询

  1. public class EsSearch {
  2.  
  3.     public static void main(String[] args) throws IOException {
  4.  
  5.         // 创建客户端对象
  6.         RestHighLevelClient client = new RestHighLevelClient(
  7.                 RestClient.builder(new HttpHost("127.0.0.1", 9200, "http"))
  8.         );
  9.  
  10.         // 关闭客户端连接
  11.         client.close();
  12.     }
  13.  
  14.     // 查询所有索引数据
  15.     public static void matchAllQuery(RestHighLevelClient client) throws IOException {
  16.         // 创建搜索请求对象
  17.         SearchRequest request = new SearchRequest();
  18.         request.indices("student");
  19.  
  20.         // 构建查询的请求体
  21.         SearchSourceBuilder sourceBuilder = new SearchSourceBuilder();
  22.         // 查询所有数据
  23.         sourceBuilder.query(QueryBuilders.matchAllQuery());
  24.         request.source(sourceBuilder);
  25.  
  26.         SearchResponse response = client.search(request, RequestOptions.DEFAULT);
  27.  
  28.         // 查询匹配
  29.         SearchHits hits = response.getHits();
  30.         System.out.println("took: " + response.getTook());
  31.         System.out.println("timeout: " + response.isTimedOut());
  32.         System.out.println("total: " + hits.getTotalHits());
  33.         System.out.println("MaxScore: " + hits.getMaxScore());
  34.         System.out.println("hits------------->");
  35.         for (SearchHit hit : hits) {
  36.             // 输出每条查询的结果信息
  37.             System.out.println(hit.getSourceAsString());
  38.         }
  39.         System.out.println("<-----------------");
  40.  
  41.     }
  42.  
  43.     // term查询，查询条件为关键字
  44.     public static void termQuery(RestHighLevelClient client) throws IOException {
  45.         // 创建搜索请求对象
  46.         SearchRequest request = new SearchRequest();
  47.         request.indices("student");
  48.  
  49.         // 构建查询的请求体
  50.         SearchSourceBuilder sourceBuilder = new SearchSourceBuilder();
  51.         // 查询所有数据
  52.         sourceBuilder.query(QueryBuilders.termQuery("age", "30"));
  53.         request.source(sourceBuilder);
  54.  
  55.         SearchResponse response = client.search(request, RequestOptions.DEFAULT);
  56.  
  57.         // 查询匹配
  58.         SearchHits hits = response.getHits();
  59.         System.out.println("took: " + response.getTook());
  60.         System.out.println("timeout: " + response.isTimedOut());
  61.         System.out.println("total: " + hits.getTotalHits());
  62.         System.out.println("MaxScore: " + hits.getMaxScore());
  63.         System.out.println("hits------------->");
  64.         for (SearchHit hit : hits) {
  65.             // 输出每条查询的结果信息
  66.             System.out.println(hit.getSourceAsString());
  67.         }
  68.         System.out.println("<-----------------");
  69.     }
  70.  
  71.     // 分页查询
  72.     public static void pageQuery(RestHighLevelClient client) throws IOException {
  73.         // 创建搜索请求对象
  74.         SearchRequest request = new SearchRequest();
  75.         request.indices("student");
  76.  
  77.         // 构建查询的请求体
  78.         SearchSourceBuilder sourceBuilder = new SearchSourceBuilder();
  79.         // 查询所有数据
  80.         sourceBuilder.query(QueryBuilders.matchAllQuery());
  81.  
  82.         // 分页查询
  83.         // 当前页起始索引(第一条数据的顺序号)，from
  84.         sourceBuilder.from(0);
  85.         // 每页显示多少条size
  86.         sourceBuilder.size(2);
  87.  
  88.         request.source(sourceBuilder);
  89.         SearchResponse response = client.search(request, RequestOptions.DEFAULT);
  90.  
  91.         // 查询匹配
  92.         SearchHits hits = response.getHits();
  93.         System.out.println("took: " + response.getTook());
  94.         System.out.println("timeout: " + response.isTimedOut());
  95.         System.out.println("total: " + hits.getTotalHits());
  96.         System.out.println("MaxScore: " + hits.getMaxScore());
  97.         System.out.println("hits------------->");
  98.         for (SearchHit hit : hits) {
  99.             // 输出每条查询的结果信息
  100.             System.out.println(hit.getSourceAsString());
  101.         }
  102.         System.out.println("<-----------------");
  103.     }
  104.  
  105.     // 数据排序
  106.     public static void sortOrderQuery(RestHighLevelClient client) throws IOException {
  107.         // 创建搜索请求对象
  108.         SearchRequest request = new SearchRequest();
  109.         request.indices("student");
  110.  
  111.         // 构建查询的请求体
  112.         SearchSourceBuilder sourceBuilder = new SearchSourceBuilder();
  113.         // 查询所有数据
  114.         sourceBuilder.query(QueryBuilders.matchAllQuery());
  115.  
  116.         // 排序
  117.         sourceBuilder.sort("age", SortOrder.ASC);
  118.  
  119.         request.source(sourceBuilder);
  120.         SearchResponse response = client.search(request, RequestOptions.DEFAULT);
  121.  
  122.         // 查询匹配
  123.         SearchHits hits = response.getHits();
  124.         System.out.println("took: " + response.getTook());
  125.         System.out.println("timeout: " + response.isTimedOut());
  126.         System.out.println("total: " + hits.getTotalHits());
  127.         System.out.println("MaxScore: " + hits.getMaxScore());
  128.         System.out.println("hits------------->");
  129.         for (SearchHit hit : hits) {
  130.             // 输出每条查询的结果信息
  131.             System.out.println(hit.getSourceAsString());
  132.         }
  133.         System.out.println("<-----------------");
  134.     }
  135.  
  136.     // 过滤字段
  137.     public static void filterFieldsQuery(RestHighLevelClient client) throws IOException {
  138.         // 创建搜索请求对象
  139.         SearchRequest request = new SearchRequest();
  140.         request.indices("student");
  141.  
  142.         // 构建查询的请求体
  143.         SearchSourceBuilder sourceBuilder = new SearchSourceBuilder();
  144.         // 查询所有数据
  145.         sourceBuilder.query(QueryBuilders.matchAllQuery());
  146.  
  147.         // 查询字段过滤
  148.         String[] excludes = {};
  149.         String[] includes = {"name", "age"};
  150.         sourceBuilder.fetchSource(includes, excludes);
  151.  
  152.         request.source(sourceBuilder);
  153.         SearchResponse response = client.search(request, RequestOptions.DEFAULT);
  154.  
  155.         // 查询匹配
  156.         SearchHits hits = response.getHits();
  157.         System.out.println("took: " + response.getTook());
  158.         System.out.println("timeout: " + response.isTimedOut());
  159.         System.out.println("total: " + hits.getTotalHits());
  160.         System.out.println("MaxScore: " + hits.getMaxScore());
  161.         System.out.println("hits------------->");
  162.         for (SearchHit hit : hits) {
  163.             // 输出每条查询的结果信息
  164.             System.out.println(hit.getSourceAsString());
  165.         }
  166.         System.out.println("<-----------------");
  167.     }
  168.  
  169.     // Bool查询
  170.     public static void boolQuery(RestHighLevelClient client) throws IOException {
  171.         // 创建搜索请求对象
  172.         SearchRequest request = new SearchRequest();
  173.         request.indices("student");
  174.  
  175.         // 构建查询的请求体
  176.         SearchSourceBuilder sourceBuilder = new SearchSourceBuilder();
  177.  
  178.         BoolQueryBuilder boolQueryBuilder = QueryBuilders.boolQuery();
  179.         // 必须包含
  180.         boolQueryBuilder.must(QueryBuilders.matchQuery("age", "30"));
  181.         // 一定不含
  182.         boolQueryBuilder.mustNot(QueryBuilders.matchQuery("name", "zhangsan"));
  183.         // 可能包含
  184.         boolQueryBuilder.should(QueryBuilders.matchQuery("sex", "男"));
  185.  
  186.         // 查询所有数据
  187.         sourceBuilder.query(boolQueryBuilder);
  188.         request.source(sourceBuilder);
  189.         SearchResponse response = client.search(request, RequestOptions.DEFAULT);
  190.  
  191.         // 查询匹配
  192.         SearchHits hits = response.getHits();
  193.         System.out.println("took: " + response.getTook());
  194.         System.out.println("timeout: " + response.isTimedOut());
  195.         System.out.println("total: " + hits.getTotalHits());
  196.         System.out.println("MaxScore: " + hits.getMaxScore());
  197.         System.out.println("hits------------->");
  198.         for (SearchHit hit : hits) {
  199.             // 输出每条查询的结果信息
  200.             System.out.println(hit.getSourceAsString());
  201.         }
  202.         System.out.println("<-----------------");
  203.     }
  204.  
  205.     // 范围查询
  206.     public static void rangeQuery(RestHighLevelClient client) throws IOException {
  207.         // 创建搜索请求对象
  208.         SearchRequest request = new SearchRequest();
  209.         request.indices("student");
  210.  
  211.         // 构建查询的请求体
  212.         SearchSourceBuilder sourceBuilder = new SearchSourceBuilder();
  213.  
  214.         RangeQueryBuilder rangeQuery = QueryBuilders.rangeQuery("age");
  215.         // 大于等于
  216.         rangeQuery.gte("30");
  217.         // 小于等于
  218.         rangeQuery.lte("40");
  219.  
  220.  
  221.         // 查询所有数据
  222.         sourceBuilder.query(rangeQuery);
  223.         request.source(sourceBuilder);
  224.         SearchResponse response = client.search(request, RequestOptions.DEFAULT);
  225.  
  226.         // 查询匹配
  227.         SearchHits hits = response.getHits();
  228.         System.out.println("took: " + response.getTook());
  229.         System.out.println("timeout: " + response.isTimedOut());
  230.         System.out.println("total: " + hits.getTotalHits());
  231.         System.out.println("MaxScore: " + hits.getMaxScore());
  232.         System.out.println("hits------------->");
  233.         for (SearchHit hit : hits) {
  234.             // 输出每条查询的结果信息
  235.             System.out.println(hit.getSourceAsString());
  236.         }
  237.         System.out.println("<-----------------");
  238.     }
  239.  
  240.     // 范围查询
  241.     public static void fuzzyQuery(RestHighLevelClient client) throws IOException {
  242.         // 创建搜索请求对象
  243.         SearchRequest request = new SearchRequest();
  244.         request.indices("student");
  245.  
  246.         // 构建查询的请求体
  247.         SearchSourceBuilder sourceBuilder = new SearchSourceBuilder();
  248.  
  249.         // 查询所有数据
  250.         sourceBuilder.query(QueryBuilders.fuzzyQuery("name", "zhangsan").fuzziness(Fuzziness.ONE));
  251.         request.source(sourceBuilder);
  252.         SearchResponse response = client.search(request, RequestOptions.DEFAULT);
  253.  
  254.         // 查询匹配
  255.         SearchHits hits = response.getHits();
  256.         System.out.println("took: " + response.getTook());
  257.         System.out.println("timeout: " + response.isTimedOut());
  258.         System.out.println("total: " + hits.getTotalHits());
  259.         System.out.println("MaxScore: " + hits.getMaxScore());
  260.         System.out.println("hits------------->");
  261.         for (SearchHit hit : hits) {
  262.             // 输出每条查询的结果信息
  263.             System.out.println(hit.getSourceAsString());
  264.         }
  265.         System.out.println("<-----------------");
  266.     }
  267.  
  268.     // 高亮查询
  269.     public static void highLightQuery(RestHighLevelClient client) throws IOException {
  270.         // 创建搜索请求对象
  271.         SearchRequest request = new SearchRequest();
  272.         request.indices("student");
  273.  
  274.         // 构建查询的请求体
  275.         SearchSourceBuilder sourceBuilder = new SearchSourceBuilder();
  276.  
  277.         // 构建查询方式: 高亮查询
  278.         TermsQueryBuilder termsQueryBuilder = QueryBuilders.termsQuery("name", "zhangsan");
  279.         // 设置查询方式
  280.         sourceBuilder.query(termsQueryBuilder);
  281.  
  282.         // 构建高亮字段
  283.         HighlightBuilder highlightBuilder = new HighlightBuilder();
  284.         // 设置标签前缀
  285.         highlightBuilder.preTags("<font color='red'>");
  286.         // 设置标签后缀
  287.         highlightBuilder.postTags("</font>");
  288.         // 设置高亮字段
  289.         highlightBuilder.field("name");
  290.         // 设置高亮构建对象
  291.         sourceBuilder.highlighter(highlightBuilder);
  292.         // 设置请求体
  293.         request.source(sourceBuilder);
  294.  
  295.         SearchResponse response = client.search(request, RequestOptions.DEFAULT);
  296.  
  297.         // 查询匹配
  298.         SearchHits hits = response.getHits();
  299.         System.out.println("took: " + response.getTook());
  300.         System.out.println("timeout: " + response.isTimedOut());
  301.         System.out.println("total: " + hits.getTotalHits());
  302.         System.out.println("MaxScore: " + hits.getMaxScore());
  303.         System.out.println("hits------------->");
  304.         for (SearchHit hit : hits) {
  305.             // 输出每条查询的结果信息
  306.             System.out.println(hit.getSourceAsString());
  307.         }
  308.         System.out.println("<-----------------");
  309.     }
  310.  
  311.     // 聚合查询
  312.     public static void AggrQuery(RestHighLevelClient client) throws IOException {
  313.         // 创建搜索请求对象
  314.         SearchRequest request = new SearchRequest();
  315.         request.indices("student");
  316.  
  317.         // 构建查询的请求体
  318.         SearchSourceBuilder sourceBuilder = new SearchSourceBuilder();
  319.         sourceBuilder.aggregation(AggregationBuilders.max("maxAge").field("age"));
  320.         // 设置请求体
  321.         request.source(sourceBuilder);
  322.         // 客户端发送请求，获取响应对象
  323.         SearchResponse response = client.search(request, RequestOptions.DEFAULT);
  324.  
  325.         // 查询匹配
  326.         SearchHits hits = response.getHits();
  327.         System.out.println("took: " + response.getTook());
  328.         System.out.println("timeout: " + response.isTimedOut());
  329.         System.out.println("total: " + hits.getTotalHits());
  330.         System.out.println("MaxScore: " + hits.getMaxScore());
  331.         System.out.println("hits------------->");
  332.         for (SearchHit hit : hits) {
  333.             // 输出每条查询的结果信息
  334.             System.out.println(hit.getSourceAsString());
  335.         }
  336.         System.out.println("<-----------------");
  337.     }
  338.  
  339.     // 分组统计
  340.     public static void groupQuery(RestHighLevelClient client) throws IOException {
  341.         // 创建搜索请求对象
  342.         SearchRequest request = new SearchRequest();
  343.         request.indices("student");
  344.  
  345.         // 构建查询的请求体
  346.         SearchSourceBuilder sourceBuilder = new SearchSourceBuilder();
  347.         sourceBuilder.aggregation(AggregationBuilders.terms("age_group_by").field("age"));
  348.         // 设置请求体
  349.         request.source(sourceBuilder);
  350.         // 客户端发送请求，获取响应对象
  351.         SearchResponse response = client.search(request, RequestOptions.DEFAULT);
  352.  
  353.         // 查询匹配
  354.         SearchHits hits = response.getHits();
  355.         System.out.println("took: " + response.getTook());
  356.         System.out.println("timeout: " + response.isTimedOut());
  357.         System.out.println("total: " + hits.getTotalHits());
  358.         System.out.println("MaxScore: " + hits.getMaxScore());
  359.         System.out.println("hits------------->");
  360.         for (SearchHit hit : hits) {
  361.             // 输出每条查询的结果信息
  362.             System.out.println(hit.getSourceAsString());
  363.         }
  364.         System.out.println("<-----------------");
  365.     }
  366. }

二、springboot项目集成Spring Data操作Elasticsearch

        Spring Data是一个用于简化数据库、非关系型数据库、索引库访问，并支持云服务的开源框架。  其主要目标是使得对数据的访问变得方便快捷，并支持 map reduce 框架和云计算数据服务。 Spring Data 可以极大的简化 JPA Elasticsearch …）的写法，可以在几乎不用写实现的情况下，实现对数据的访问和操作。  除了 CRUD 外，还包括如分页、排序等一些常用的功能。官网地址：https://spring.io/projects/spring-data

        Spring Data Elasticsearch基于 spring data API 简化 Elasticsearch 操作，将原始操作Elasticsearch 的客户端 API 进行封装 。 Spring Data 为 Elasticsearch 项目提供集成搜索引擎。  Spring Data Elasticsearch POJO 的关键功能区域为中心的模型与 Elastichsearch 交互文档和轻松地编写一个存储索引库数据访问层。

1）pom文件

  1. <?xml version="1.0" encoding="UTF-8"?>
  2. <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
  3.          xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 https://maven.apache.org/xsd/maven-4.0.0.xsd">
  4.     <modelVersion>4.0.0</modelVersion>
  5.     <parent>
  6.         <groupId>org.springframework.boot</groupId>
  7.         <artifactId>spring-boot-starter-parent</artifactId>
  8.         <version>2.3.6.RELEASE</version>
  9.         <relativePath/> <!-- lookup parent from repository -->
  10.     </parent>
  11.     <groupId>com.best</groupId>
  12.     <artifactId>best-es</artifactId>
  13.     <version>0.0.1-SNAPSHOT</version>
  14.     <name>best-es</name>
  15.     <description>Demo project for Spring Boot</description>
  16.  
  17.     <properties>
  18.         <maven.compiler.source>8</maven.compiler.source>
  19.         <maven.compiler.target>8</maven.compiler.target>
  20.     </properties>
  21.  
  22.     <dependencies>
  23.         <dependency>
  24.             <groupId>org.projectlombok</groupId>
  25.             <artifactId>lombok</artifactId>
  26.             <version>1.16.12</version>
  27.         </dependency>
  28.  
  29.         <dependency>
  30.             <groupId>org.springframework.boot</groupId>
  31.             <artifactId>spring-boot-starter</artifactId>
  32.         </dependency>
  33.  
  34.         <dependency>
  35.             <groupId>org.springframework.boot</groupId>
  36.             <artifactId>spring-boot-starter-data-elasticsearch</artifactId>
  37.         </dependency>
  38.  
  39.         <dependency>
  40.             <groupId>org.springframework.boot</groupId>
  41.             <artifactId>spring-boot-devtools</artifactId>
  42.             <scope>runtime</scope>
  43.             <optional>true</optional>
  44.         </dependency>
  45.  
  46.         <dependency>
  47.             <groupId>org.springframework.boot</groupId>
  48.             <artifactId>spring-boot-starter-test</artifactId>
  49.             <scope>test</scope>
  50.         </dependency>
  51.  
  52.         <dependency>
  53.             <groupId>org.elasticsearch</groupId>
  54.             <artifactId>elasticsearch</artifactId>
  55.             <version>7.8.0</version>
  56.         </dependency>
  57.         <!-- elasticsearch 的客户端 -->
  58.         <dependency>
  59.             <groupId>org.elasticsearch.client</groupId>
  60.             <artifactId>elasticsearch-rest-high-level-client</artifactId>
  61.             <version>7.8.0</version>
  62.         </dependency>
  63.         <!-- elasticsearch 依赖 2.x 的 log4j -->
  64.         <dependency>
  65.             <groupId>org.apache.logging.log4j</groupId>
  66.             <artifactId>log4j-api</artifactId>
  67.             <version>2.8.2</version>
  68.         </dependency>
  69.         <dependency>
  70.             <groupId>org.apache.logging.log4j</groupId>
  71.             <artifactId>log4j-core</artifactId>
  72.             <version>2.8.2</version>
  73.         </dependency>
  74.         <dependency>
  75.             <groupId>com.fasterxml.jackson.core</groupId>
  76.             <artifactId>jackson-databind</artifactId>
  77.             <version>2.9.9</version>
  78.         </dependency>
  79.         <!-- junit 单元测试 -->
  80.         <dependency>
  81.             <groupId>junit</groupId>
  82.             <artifactId>junit</artifactId>
  83.             <version>4.12</version>
  84.         </dependency>
  85.  
  86.         <dependency>
  87.             <groupId>org.springframework.boot</groupId>
  88.             <artifactId>spring-boot-test</artifactId>
  89.         </dependency>
  90.  
  91.         <dependency>
  92.             <groupId>org.springframework</groupId>
  93.             <artifactId>spring-test</artifactId>
  94.         </dependency>
  95.     </dependencies>
  96.  
  97.     <build>
  98.         <plugins>
  99.             <plugin>
  100.                 <groupId>org.springframework.boot</groupId>
  101.                 <artifactId>spring-boot-maven-plugin</artifactId>
  102.             </plugin>
  103.         </plugins>
  104.     </build>
  105.  
  106. </project>

2）yaml

  1. # 端口号
  2. server:
  3.   port: 8080
  4.  
  5. # es服务地址与端口
  6. elasticsearch:
  7.   host: 127.0.0.1
  8.   port: 9200
  9.  
  10. # 配置日志级别，开启debug日志
  11. logging:
  12.   level:
  13.     com:
  14.       best: debug

3）数据实体类

  1. @Data
  2. @NoArgsConstructor
  3. @AllArgsConstructor
  4. @ToString
  5. @Document(indexName = "shopping", shards = 3, replicas = 1)
  6. public class Product {
  7.  
  8.     // 商品唯一标识, 必须有id, 这里的id 是全局唯一的标识，等同于es中的"_id"
  9.     @Id
  10.     private Long id;
  11.  
  12.     /**
  13.      * type: 字段数据类型
  14.      * analyzer: 分词器类型
  15.      * index: 是否索引(默认:true)
  16.      * Keyword: 短语, 不进行分词
  17.      */
  18.     // 商品名称
  19.     @Field(type = FieldType.Text, analyzer = "ik_max_word")
  20.     private String title;
  21.  
  22.     // 分类名称
  23.     @Field(type = FieldType.Keyword)
  24.     private String category;
  25.  
  26.     // 商品价格
  27.     @Field(type = FieldType.Double)
  28.     private Double price;
  29.  
  30.     // 图片地址
  31.     @Field(type = FieldType.Keyword, index = false)
  32.     private String images;
  33. }

4）配置类

        ElasticsearchRestTemplate是spring-data-elasticsearch项目中的一个类，和其他spring项目中的 template类似。在新版的spring-data-elasticsearch 中，ElasticsearchRestTemplate 代替了原来的ElasticsearchTemplate。原因是ElasticsearchTemplate基于TransportClient，TransportClient即将在8.x 以后的版本中移除。

        我们推荐使用ElasticsearchRestTemplate。ElasticsearchRestTemplate基于RestHighLevelClient客户端的。需要自定义配置类，继承AbstractElasticsearchConfiguration，并实现elasticsearchClient()抽象方法，创建RestHighLevelClient对象。

AbstractElasticsearchConfiguration源码：

  1. public abstract class AbstractElasticsearchConfiguration extends ElasticsearchConfigurationSupport {
  2.  
  3. 	//需重写本方法
  4. 	public abstract RestHighLevelClient elasticsearchClient();
  5.  
  6. 	@Bean(name = { "elasticsearchOperations", "elasticsearchTemplate" })
  7. 	public ElasticsearchOperations elasticsearchOperations(ElasticsearchConverter elasticsearchConverter) {
  8. 		return new ElasticsearchRestTemplate(elasticsearchClient(), elasticsearchConverter);
  9. 	}
  10. }

        需要自定义配置类，继承AbstractElasticsearchConfiguration，并实现elasticsearchClient()抽象方法，创建RestHighLevelClient对象。 

  1. @Data
  2. @Configuration
  3. @ConfigurationProperties(prefix = "elasticsearch")
  4. public class ElasticsearchConfig extends AbstractElasticsearchConfiguration {
  5.  
  6.     private String host;
  7.  
  8.     private Integer port;
  9.  
  10.     @Override
  11.     public RestHighLevelClient elasticsearchClient() {
  12.         RestClientBuilder builder = RestClient.builder(new HttpHost(host, port));
  13.         return new RestHighLevelClient(builder);
  14.     }
  15. }

5）Dao数据访问对象

  1. @Repository
  2. public interface ProductDao extends ElasticsearchRepository<Product, Long> {
  3. }

6）索引操作

  1. @SpringBootTest
  2. class BestEsApplicationTests {
  3.  
  4.     @Autowired
  5.     private ElasticsearchRestTemplate elasticsearchRestTemplate;
  6.  
  7.     @Test
  8.     public void creatIndex() {
  9.         // 创建索引并增加映射配置
  10.         // 创建索引，系统初始化会自动创建索引
  11.         System.out.println("创建索引");
  12.     }
  13.  
  14.     @Test
  15.     public void deleteIndex() {
  16.         boolean flag = elasticsearchRestTemplate.deleteIndex(Product.class);
  17.         System.out.println("删除索引: " + flag);
  18.     }
  19.  
  20. }

7）文档操作

  1. @SpringBootTest
  2. public class SpringDataEsProductDaoTest {
  3.  
  4.     @Autowired
  5.     private ProductDao productDao;
  6.     
  7.     /**
  8.      * 新增
  9.      */
  10.     @Test
  11.     public void save(){
  12.         Product product = new Product();
  13.         product.setId(2L);
  14.         product.setTitle("华为手机");
  15.         product.setCategory("手机");
  16.         product.setPrice(2999.0);
  17.         product.setImages("http://www.test/hw.jpg");
  18.         productDao.save(product);
  19.     }
  20.     //POSTMAN, GET http://localhost:9200/shopping/_doc/2
  21.  
  22.     //修改
  23.     @Test
  24.     public void update(){
  25.         Product product = new Product();
  26.         product.setId(2L);
  27.         product.setTitle("小米 2 手机");
  28.         product.setCategory("手机");
  29.         product.setPrice(9999.0);
  30.         product.setImages("http://www.test/xm.jpg");
  31.         productDao.save(product);
  32.     }
  33.     //POSTMAN, GET http://localhost:9200/shopping/_doc/2
  34.  
  35.  
  36.     //根据 id 查询
  37.     @Test
  38.     public void findById(){
  39.         Product product = productDao.findById(2L).get();
  40.         System.out.println(product);
  41.     }
  42.  
  43.     @Test
  44.     public void findAll(){
  45.         Iterable<Product> products = productDao.findAll();
  46.         for (Product product : products) {
  47.             System.out.println(product);
  48.         }
  49.     }
  50.  
  51.     //删除
  52.     @Test
  53.     public void delete(){
  54.         Product product = new Product();
  55.         product.setId(2L);
  56.         productDao.delete(product);
  57.     }
  58.     //POSTMAN, GET http://localhost:9200/shopping/_doc/2
  59.  
  60.     //批量新增
  61.     @Test
  62.     public void saveAll(){
  63.         List<Product> productList = new ArrayList<>();
  64.         for (int i = 0; i < 10; i++) {
  65.             Product product = new Product();
  66.             product.setId(Long.valueOf(i));
  67.             product.setTitle("["+i+"]小米手机");
  68.             product.setCategory("手机");
  69.             product.setPrice(1999.0 + i);
  70.             product.setImages("http://www.test/xm.jpg");
  71.             productList.add(product);
  72.         }
  73.         productDao.saveAll(productList);
  74.     }
  75.  
  76.     //分页查询
  77.     @Test
  78.     public void findByPageable(){
  79.         //设置排序(排序方式，正序还是倒序，排序的 id)
  80.         Sort sort = Sort.by(Sort.Direction.DESC,"id");
  81.         int currentPage=0;//当前页，第一页从 0 开始， 1 表示第二页
  82.         int pageSize = 5;//每页显示多少条
  83.         //设置查询分页
  84.         PageRequest pageRequest = PageRequest.of(currentPage, pageSize,sort);
  85.         //分页查询
  86.         Page<Product> productPage = productDao.findAll(pageRequest);
  87.         for (Product Product : productPage.getContent()) {
  88.             System.out.println(Product);
  89.         }
  90.     }
  91. }

8）文档搜索

  1. @SpringBootTest
  2. public class SpringDataEsSearchTest {
  3.  
  4.     @Autowired
  5.     private ProductDao productDao;
  6.  
  7.     /**
  8.      * term 查询
  9.      * search(termQueryBuilder) 调用搜索方法，参数查询构建器对象
  10.      */
  11.     @Test
  12.     public void termQuery(){
  13.         TermQueryBuilder termQueryBuilder = QueryBuilders.termQuery("title", "小米");
  14.         Iterable<Product> products = productDao.search(termQueryBuilder);
  15.         for (Product product : products) {
  16.             System.out.println(product);
  17.         }
  18.     }
  19.     /**
  20.      * term 查询加分页
  21.      */
  22.     @Test
  23.     public void termQueryByPage(){
  24.         int currentPage= 0 ;
  25.         int pageSize = 5;
  26.         //设置查询分页
  27.         PageRequest pageRequest = PageRequest.of(currentPage, pageSize);
  28.         TermQueryBuilder termQueryBuilder = QueryBuilders.termQuery("category", "手机");
  29.         Iterable<Product> products =
  30.                 productDao.search(termQueryBuilder,pageRequest);
  31.         for (Product product : products) {
  32.             System.out.println(product);
  33.         }
  34.     }
  35.  
  36. }

参考原文地址： 

三、springboot项目集成bboss操作elasticsearch

1）pom文件和配置

pom文件引入依赖：

  1.         <dependency>
  2.             <groupId>com.bbossgroups.plugins</groupId>
  3.             <artifactId>bboss-elasticsearch-rest-jdbc</artifactId>
  4.             <version>6.1.8</version>
  5.         </dependency>
  6.         <dependency>
  7.             <groupId>com.bbossgroups.plugins</groupId>
  8.             <artifactId>bboss-elasticsearch-spring-boot-starter</artifactId>
  9.             <version>6.1.8</version>
  10.         </dependency>

application.properties配置：

  1. ##ES集群配置，支持x-pack和searchguard
  2. #spring.elasticsearch.bboss.elasticUser=elastic
  3. #spring.elasticsearch.bboss.elasticPassword=changeme
  4.  
  5.  
  6. spring.elasticsearch.bboss.elasticsearch.rest.hostNames=192.168.57.128:9200
  7. #spring.elasticsearch.bboss.elasticsearch.rest.hostNames=10.180.211.27:9280,10.180.211.27:9281,10.180.211.27:9282
  8. ##https配置，添加https://协议头
  9. #spring.elasticsearch.bboss.default.elasticsearch.rest.hostNames=https://10.180.211.27:9280,https://10.180.211.27:9281,https://10.180.211.27:9282
  10. spring.elasticsearch.bboss.elasticsearch.dateFormat=yyyy.MM.dd
  11. spring.elasticsearch.bboss.elasticsearch.timeZone=Asia/Shanghai
  12. spring.elasticsearch.bboss.elasticsearch.ttl=2d
  13. #在控制台输出脚本调试开关showTemplate,false关闭，true打开，同时log4j至少是info级别
  14. spring.elasticsearch.bboss.elasticsearch.showTemplate=true
  15. spring.elasticsearch.bboss.elasticsearch.discoverHost=false
  16. # dsl配置文件热加载扫描时间间隔，毫秒为单位，默认5秒扫描一次，<= 0时关闭扫描机制
  17. spring.elasticsearch.bboss.dslfile.refreshInterval = -1
  18.  
  19. ##es client http连接池配置
  20. spring.elasticsearch.bboss.http.timeoutConnection = 50000
  21. spring.elasticsearch.bboss.http.timeoutSocket = 50000
  22. spring.elasticsearch.bboss.http.connectionRequestTimeout=50000
  23. spring.elasticsearch.bboss.http.retryTime = 1
  24. spring.elasticsearch.bboss.http.maxLineLength = -1
  25. spring.elasticsearch.bboss.http.maxHeaderCount = 200
  26. spring.elasticsearch.bboss.http.maxTotal = 400
  27. spring.elasticsearch.bboss.http.defaultMaxPerRoute = 200
  28. spring.elasticsearch.bboss.http.soReuseAddress = false
  29. spring.elasticsearch.bboss.http.soKeepAlive = false
  30. spring.elasticsearch.bboss.http.timeToLive = 3600000
  31. spring.elasticsearch.bboss.http.keepAlive = 3600000
  32. spring.elasticsearch.bboss.http.keystore =
  33. spring.elasticsearch.bboss.http.keyPassword =
  34. # ssl 主机名称校验，是否采用default配置，
  35. # 如果指定为default，就采用DefaultHostnameVerifier,否则采用 SSLConnectionSocketFactory.ALLOW_ALL_HOSTNAME_VERIFIER
  36. spring.elasticsearch.bboss.http.hostnameVerifier =

2）getConfigRestClientUtil和getRestClientUtil区别

1. getConfigRestClientUtil获取在配置文件中根据DSL名称定义的DSL并执行它：

  1. <properties>  
  2.     <!--  
  3.         sql query  
  4.     -->  
  5.     <property name="sqlQuery">  
  6.         <!\[CDATA\[  
  7.          {"query": "SELECT * FROM dbclobdemo where channelId=#\[channelId\]"}  
  8.         \]\]>  
  9.     </property>  
  10. </properties>

写入的params参数在xml文件中通过 #[参数名] 来自动注入到 DSL中

  1. ClientInterface clientUtil = ElasticSearchHelper.getConfigRestClientUtil("esmapper/sql.xml");//define an instanceof ConfigRestClientUtil,It's single instance, multithreaded secure.  
  2. Map params = new HashMap();  
  3. params.put("channelId",1);  
  4. List<Map> json = clientUtil.sql(Map.class,"sqlQuery",params);

2. getRestClientUtil直接执行代码中定义的DSL：

  1. ClientInterface clientUtil = ElasticSearchHelper.getRestClientUtil();//define an instanceof RestClientUtil,It's single instance, multithreaded secure.  
  2. List<Map> json = clientUtil.sql(Map.class,"{\\"query\\": \\"SELECT * FROM demo\\"}");  
  3.

3）创建索引

1.普通创建

  1. @SpringBootTest
  2. class EsBbossTest {
  3.     @Autowired
  4.     private BBossESStarter bbossESStarter;
  5.  
  6.     /**
  7.      *创建索引
  8.      */
  9.     @Test
  10.     public void createIndex(){
  11.         String result = bbossESStarter.getRestClient().createIndiceMapping("blog","");
  12.         System.out.println(result);
  13.     }
  14. }

2.自定义mapping

先创建一个dsl脚本文件，在里面自定义mapping规则：

  1. <propertys>
  2.     <property name="create51jobIndex">//每个property中的name属性表示当前mapping的命名，一个xml文件里可设置多个dsl脚本
  3.         <![CDATA[{
  4.             "settings": {
  5.                 "number_of_shards": 1,
  6.                 "number_of_replicas": 1,
  7.                 "index.refresh_interval": "5s"
  8.             },
  9.             "mappings": {
  10.                     "properties": {
  11.                         "job":{
  12.                             "type":"text"
  13.                         },
  14.                         "company": {
  15.                             "type": "text"
  16.                         },
  17.                         "place": {
  18.                             "type": "text"
  19.                         },
  20.                         "salar": {
  21.                             "type": "text"
  22.                         },
  23.                         "data": {
  24.                             "type": "date",
  25.                             "format":"yyyy-MM-dd HH:mm:ss.SSS||yyyy-MM-dd'T'HH:mm:ss.SSS||yyyy-MM-dd HH:mm:ss||epoch_millis"
  26.                         }
  27.                     }
  28.             }
  29.         }]]>
  30.     </property>
  31. </propertys>

然后创建客户端，并且调用创建索引api：

  1. @SpringBootTest
  2. class EsBbossTest {
  3.     @Autowired
  4.     private BBossESStarter bbossESStarter;
  5.  
  6.     /**
  7.      *创建索引
  8.      */
  9.     @Test
  10.     public void createIndex(){
  11.         ClientInterface clientUtil = bbossESStarter.getConfigRestClient("esmapper/job.xml");
  12.         String result = clientUtil.createIndiceMapping("51job","create51jobIndex");
  13.         System.out.println(result);
  14.     }
  15. }

4）删除索引

  1. @SpringBootTest
  2. class EsBbossTest {
  3.     @Autowired
  4.     private BBossESStarter bbossESStarter;
  5.  
  6.     /**
  7.      *删除索引
  8.      */
  9.     @Test
  10.     public void dropIndex(){
  11.         String result = bbossESStarter.getRestClient().dropIndice("blog");
  12.         System.out.println(result);
  13.     }
  14. }

5）判断索引是否存在

  1. @SpringBootTest
  2. class EsBbossTest {
  3.     @Autowired
  4.     private BBossESStarter bbossESStarter;
  5.  
  6.     /**
  7.      *判断索引是否存在
  8.      */
  9.     @Test
  10.     public void indexIsExists(){
  11.         boolean exist = bbossESStarter.getRestClient().existIndice("51job");
  12.         System.out.println(exist);
  13.     }
  14. }

6）判断索引类型是否存在

  1. @SpringBootTest
  2. class EsBbossTest {
  3.     @Autowired
  4.     private BBossESStarter bbossESStarter;
  5.  
  6.     /**
  7.      *判断索引类型是否存在
  8.      */
  9.     @Test
  10.     public void typeIsExists(){
  11.         boolean exist = bbossESStarter.getRestClient().existIndiceType("51job","_doc");
  12.         System.out.println(exist);
  13.     }
  14. }

7）添加单个文档

  1. @SpringBootTest
  2. class EsBbossTest {
  3.     @Autowired
  4.     private BBossESStarter bbossESStarter;
  5.  
  6.     /**
  7.      *指定索引添加单个文档
  8.      */
  9.     @Test
  10.     public void addDocument(){
  11.         Qcpage qcpage=new Qcpage();
  12.         qcpage.setCompany("xxxxxx有限公司").setData("2022-11-22 21:18:12").setJob("Java开发工程师").setPlace("深圳南山").setSalar("13000/月");
  13.         String result = bbossESStarter.getRestClient().addDocument("51job",qcpage);
  14.         System.out.println(result);
  15.     }
  16. }

8）批量添加文档

  1. @SpringBootTest
  2. class EsBbossTest {
  3.     @Autowired
  4.     private BBossESStarter bbossESStarter;
  5.     @Autowired
  6.     QcpageService qcpageService;
  7.  
  8.     /**
  9.      *批量添加文档(此处从mysql取出来1300条数据测试)
  10.      */
  11.     @Test
  12.     public void batchAddDocument(){
  13.         List<Qcpage> list=qcpageService.list();
  14.         long startTime = System.currentTimeMillis();
  15.         String result = bbossESStarter.getRestClient().addDocuments("51job",list);
  16.         long endTime = System.currentTimeMillis();
  17.         System.out.println("添加"+list.size()+"条数据耗时:" + (endTime - startTime)/1000 + "s");
  18.         System.out.println(result);
  19.     }
  20. }

9）查询单个文档

  1. @SpringBootTest
  2. class EsBbossTest {
  3.     @Autowired
  4.     private BBossESStarter bbossESStarter;
  5.  
  6.     /**
  7.      *查询一个文档
  8.      */
  9.     @Test
  10.     public void getDocument(){
  11.         String result = bbossESStarter.getRestClient().getDocument("51job","7pJsGXMBBreT5daW4X1w");
  12.         System.out.println(result);
  13.     }
  14. }

参考原文地址：http://t.csdn.cn/hm0y7

声明：本文内容由网友自发贡献，不代表【wpsshop博客】立场，版权归原作者所有，本站不承担相应法律责任。如您发现有侵权的内容，请联系我们。转载请注明出处：https://www.wpsshop.cn/w/羊村懒王/article/detail/68408?site
推荐阅读
相关标签

Copyright © 2003-2013 www.wpsshop.cn 版权所有，并保留所有权利。

  

闽ICP备14008679号