devbox
我家自动化
这个屌丝很懒，什么也没留下！
关注作者
热门标签
热门文章
当前位置:   article > 正文

【云原生】整合K8s + SpringCloudK8s + gRpc + RocketMQ + Istio + Envoy

作者：我家自动化 | 2024-03-02 17:48:57

赞

踩

【云原生】整合K8s + SpringCloudK8s + gRpc + RocketMQ + Istio + Envoy

背景

本文把前面的代码整理一遍，不仅仅是demo层面，而是考虑到放进生产中使用，且尽可能用高版本，关于这块技术，网上的文章真是一言难尽，要么就是个概念，要么就是把官网的demo拿过来跑一遍，质量太差。

我本地有Istio，也安装了K8s和Docker，这些都可以根据官网来安装，我这里就忽略了。

我本地使用的版本情况

  1. jdk：17
  2. spring-boot-starter-parent：2.7.9，没有上3.0.0，是因为RocketMQ还不支持，上了之后启动RocketMQ报错，所以用了3.0.0之前的最后一个版本
  3. spring-cloud-starter-kubernetes-client-all：2.1.6

架构图

功能点

  1. 在K8s容器中安装Istio，默认也会安装Envoy代理/网关，和Kiali dashboard等

  1. 把Envoy作为南北向流量网关，负责请求转发，限流等

  1. 把Envoy作为东西向业务网关，负责服务之间负载均衡等

  1. service-provider 和 service-consumer 分别暴露gRpc接口，相互调用

  1. service-provider 发送RocketMQ消息，service-consumer 多个消费组同时消费

编码

service-provider

工程结构

最外层POM

  1. <?xml version="1.0" encoding="UTF-8"?>
  2. <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
  3.          xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 https://maven.apache.org/xsd/maven-4.0.0.xsd">
  4.     <modelVersion>4.0.0</modelVersion>
  5.     <parent>
  6.         <groupId>org.springframework.boot</groupId>
  7.         <artifactId>spring-boot-starter-parent</artifactId>
  8.         <version>2.7.9</version>
  9.         <relativePath/> <!-- lookup parent from repository -->
  10.     </parent>
  11.     <groupId>com.example</groupId>
  12.     <artifactId>service-provider</artifactId>
  13.     <version>0.0.1-SNAPSHOT</version>
  14.     <packaging>pom</packaging>
  15.     <name>service-provider</name>
  16.     <description>service-provider</description>
  17.     <modules>
  18.         <module>service-provider-proto</module>
  19.         <module>service-provider-start</module>
  20.         <module>service-provider-dto</module>
  21.     </modules>
  22.     <properties>
  23.         <java.version>17</java.version>
  24.     </properties>
  25.  
  26.     <dependencyManagement>
  27.         <dependencies>
  28.             <dependency>
  29.                 <groupId>org.springframework.boot</groupId>
  30.                 <artifactId>spring-boot-dependencies</artifactId>
  31.                 <type>pom</type>
  32.                 <scope>import</scope>
  33.                 <version>2.7.9</version>
  34.             </dependency>
  35.             <dependency>
  36.                 <groupId>com.example</groupId>
  37.                 <artifactId>service-consumer-proto</artifactId>
  38.                 <version>0.0.1-SNAPSHOT</version>
  39.             </dependency>
  40.             <dependency>
  41.                 <groupId>com.example</groupId>
  42.                 <artifactId>service-provider-proto</artifactId>
  43.                 <version>0.0.1-SNAPSHOT</version>
  44.             </dependency>
  45.             <dependency>
  46.                 <groupId>com.example</groupId>
  47.                 <artifactId>service-provider-dto</artifactId>
  48.                 <version>0.0.1-SNAPSHOT</version>
  49.             </dependency>
  50.         </dependencies>
  51.     </dependencyManagement>
  52. </project>

service-provider-dto

这个模块里面主要是dto类，方便把dto模块提供给其他服务pom引用，而不是引用整个服务，我这里只有一个Order类

service-provider-proto

这里是 service-provider 暴露出去的gRpc接口，我这里暴露了一个HelloService接口

同时这里需要配置下gRpc的一些依赖和插件，然后这个模块需要被本服务（接口的实现）或者其他服务（接口的调用）引用，我们看一下 service-provider-proto 模块的pom

  1. <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
  2.          xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
  3.     <modelVersion>4.0.0</modelVersion>
  4.  
  5.     <parent>
  6.         <artifactId>service-provider</artifactId>
  7.         <groupId>com.example</groupId>
  8.         <version>0.0.1-SNAPSHOT</version>
  9.     </parent>
  10.  
  11.     <groupId>com.example</groupId>
  12.     <artifactId>service-provider-proto</artifactId>
  13.     <version>0.0.1-SNAPSHOT</version>
  14.     <packaging>jar</packaging>
  15.  
  16.     <name>service-provider-proto</name>
  17.  
  18.     <properties>
  19.         <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
  20.     </properties>
  21.  
  22.     <dependencies>
  23.         <!-- gRpc -->
  24.         <dependency>
  25.             <groupId>net.devh</groupId>
  26.             <artifactId>grpc-spring-boot-starter</artifactId>
  27.             <version>2.14.0.RELEASE</version>
  28.         </dependency>
  29.         <dependency>
  30.             <groupId>io.grpc</groupId>
  31.             <artifactId>grpc-protobuf</artifactId>
  32.             <version>1.52.1</version>
  33.         </dependency>
  34.         <dependency> <!-- necessary for Java 9+ -->
  35.             <groupId>org.apache.tomcat</groupId>
  36.             <artifactId>annotations-api</artifactId>
  37.             <version>6.0.53</version>
  38.         </dependency>
  39.     </dependencies>
  40.  
  41.     <build>
  42.         <extensions>
  43.             <extension>
  44.                 <groupId>kr.motd.maven</groupId>
  45.                 <artifactId>os-maven-plugin</artifactId>
  46.                 <version>1.7.1</version>
  47.             </extension>
  48.         </extensions>
  49.         <plugins>
  50.             <plugin>
  51.                 <groupId>org.xolstice.maven.plugins</groupId>
  52.                 <artifactId>protobuf-maven-plugin</artifactId>
  53.                 <version>0.6.1</version>
  54.                 <configuration>
  55.                     <protocArtifact>com.google.protobuf:protoc:3.21.7:exe:${os.detected.classifier}</protocArtifact>
  56.                     <pluginId>grpc-java</pluginId>
  57.                     <pluginArtifact>io.grpc:protoc-gen-grpc-java:1.52.1:exe:${os.detected.classifier}</pluginArtifact>
  58.                 </configuration>
  59.                 <executions>
  60.                     <execution>
  61.                         <goals>
  62.                             <goal>compile</goal>
  63.                             <goal>compile-custom</goal>
  64.                         </goals>
  65.                     </execution>
  66.                 </executions>
  67.             </plugin>
  68.         </plugins>
  69.     </build>
  70. </project>

service-provider-start

这里就是启动类了，我也把一些业务代码放进来了，按理说这不规范，但每个公司也有不同的分法。

我直接把代码都贴出来，不做过多的解释，方便有同学跟着写的。

ServiceProviderApplication
  1. package com.example.service.provider;
  2.  
  3. import org.springframework.boot.SpringApplication;
  4. import org.springframework.boot.autoconfigure.SpringBootApplication;
  5. import org.springframework.cloud.client.discovery.EnableDiscoveryClient;
  6.  
  7. @SpringBootApplication
  8. @EnableDiscoveryClient
  9. public class ServiceProviderApplication {
  10.  
  11.     public static void main(String[] args) {
  12.         SpringApplication.run(ServiceProviderApplication.class, args);
  13.     }
  14. }
HelloServiceImpl

这个是前面暴露HelloService的接口实现

  1. package com.example.service.provider.facade;
  2.  
  3. import com.example.service.provider.DemoConfig;
  4. import com.example.service.provider.api.HelloServiceGrpc;
  5. import com.example.service.provider.api.SayHelloData;
  6. import com.example.service.provider.api.SayHelloRequest;
  7. import com.example.service.provider.api.SayHelloResponse;
  8. import lombok.extern.slf4j.Slf4j;
  9. import net.devh.boot.grpc.server.service.GrpcService;
  10. import org.springframework.beans.factory.annotation.Autowired;
  11.  
  12. @Slf4j
  13. @GrpcService
  14. public class HelloServiceImpl extends HelloServiceGrpc.HelloServiceImplBase {
  15.  
  16.     @Autowired
  17.     private DemoConfig demoConfig;
  18.  
  19.     @Override
  20.     public void sayHello(SayHelloRequest request, io.grpc.stub.StreamObserver<SayHelloResponse> responseObserver) {
  21.         log.info("接收consumer的say hello grpc 请求");
  22.         SayHelloData helloData = SayHelloData.newBuilder()
  23.                 .setName("maple")
  24.                 .setContent(demoConfig.getMessage())
  25.                 .build();
  26.         SayHelloResponse.Builder builder = SayHelloResponse.newBuilder()
  27.                 .setCode(0)
  28.                 .setMessage("success")
  29.                 .setSuccess(true)
  30.                 .setData(helloData);
  31.         responseObserver.onNext(builder.build());
  32.         responseObserver.onCompleted();
  33.     }
  34. }
DemoConfig

这个主要是测试动态配置是否生效的

  1. package com.example.service.provider;
  2.  
  3. import org.springframework.boot.context.properties.ConfigurationProperties;
  4. import org.springframework.context.annotation.Configuration;
  5.  
  6. @Configuration
  7. @ConfigurationProperties(prefix = "bean")
  8. public class DemoConfig {
  9.  
  10.     private String message;
  11.  
  12.     public String getMessage() {
  13.         return message;
  14.     }
  15.  
  16.     public void setMessage(String message) {
  17.         this.message = message;
  18.     }
  19. }
MemberQueryGrpcClient

这个是 service-consumer 暴露出的gRpc接口，service-provider 去调用，因为生产中不同服务之间肯定是可以相互rpc调用的。

  1. package com.example.service.provider;
  2.  
  3. import com.example.service.consumer.api.MemberQueryRequest;
  4. import com.example.service.consumer.api.MemberQueryResponse;
  5. import com.example.service.consumer.api.MemberQueryServiceGrpc;
  6. import com.google.protobuf.InvalidProtocolBufferException;
  7. import lombok.extern.slf4j.Slf4j;
  8. import net.devh.boot.grpc.client.inject.GrpcClient;
  9. import org.springframework.stereotype.Service;
  10.  
  11. @Slf4j
  12. @Service
  13. public class MemberQueryGrpcClient {
  14.  
  15.     @GrpcClient("service-consumer")
  16.     private MemberQueryServiceGrpc.MemberQueryServiceBlockingStub memberQueryBlockingStub;
  17.  
  18.     public String queryMember() {
  19.  
  20.         MemberQueryRequest request = MemberQueryRequest.newBuilder().setMemberId("111").setUsername("Wang Hong Bo").build();
  21.  
  22.         MemberQueryResponse response = memberQueryBlockingStub.queryMember(request);
  23.  
  24.         log.info("MemberQueryResponse.code:{}", response.getCode());
  25.         log.info("MemberQueryResponse.message:{}", response.getMessage());
  26.         log.info("MemberQueryResponse.success:{}", response.getSuccess());
  27.         log.info("MemberQueryResponse.data:{}", response.getData());
  28.         log.info("MemberQueryResponse.address1:{}", response.getData().getAddressList().get(0).getAddress());
  29.         log.info("MemberQueryResponse.address2:{}", response.getData().getAddressList().get(1).getAddress());
  30.  
  31.         return response.toString();
  32.     }
  33. }
RocketMQProducerService

这个是MQ生产者发送消息的服务，我这里通过这个代码

String sceneStr = SceneEnum.destination(scene) 把消息做了转换，topic中间以“|”分隔，比如说我的Topic为：TP_S_1100|EC_EVENT_0001

但是在阿里云买的RocketMQ产品，它不支持topic中间以“|”分隔，认为它是特殊字符，我是本地安装的RocketMQ，它是支持的。

  1. package com.example.service.provider.producer;
  2.  
  3. import com.alibaba.fastjson.JSON;
  4. import com.example.service.provider.enums.SceneEnum;
  5. import lombok.extern.slf4j.Slf4j;
  6. import org.apache.rocketmq.client.producer.SendCallback;
  7. import org.apache.rocketmq.client.producer.SendResult;
  8. import org.apache.rocketmq.spring.core.RocketMQTemplate;
  9. import org.springframework.beans.factory.annotation.Autowired;
  10. import org.springframework.messaging.support.MessageBuilder;
  11. import org.springframework.stereotype.Component;
  12.  
  13. @Slf4j
  14. @Component
  15. public class RocketMQProducerService {
  16.  
  17.     @Autowired
  18.     private RocketMQTemplate rocketMQTemplate;
  19.  
  20.     /**
  21.      * 普通发送
  22.      *
  23.      * @param scene
  24.      * @param payload
  25.      */
  26.     public void send(SceneEnum scene, Object payload) {
  27.         String sceneStr = SceneEnum.destination(scene);
  28.         log.info("producer.sendMessage: 【{}】,【{}】", sceneStr, JSON.toJSONString(payload));
  29.         rocketMQTemplate.convertAndSend(sceneStr, payload);
  30.     }
  31.  
  32.     /**
  33.      * 同步发送
  34.      *
  35.      * @param scene
  36.      * @param payload
  37.      * @return
  38.      */
  39.     public SendResult sendSync(SceneEnum scene, Object payload) {
  40.  
  41.         String sceneStr = SceneEnum.destination(scene);
  42.  
  43.         SendResult sendResult = rocketMQTemplate.syncSend(sceneStr, payload);
  44.  
  45.         log.info("producer.sendMessage: 【{}】,【{}】, sendResult:{}", sceneStr, JSON.toJSONString(payload), sendResult);
  46.  
  47.         return sendResult;
  48.     }
  49.  
  50.     /**
  51.      * 发送异步消息
  52.      *
  53.      * @param scene
  54.      * @param payload
  55.      */
  56.     public void sendASync(SceneEnum scene, Object payload) {
  57.  
  58.         rocketMQTemplate.asyncSend(SceneEnum.destination(scene), payload, new SendCallback() {
  59.  
  60.             @Override
  61.             public void onSuccess(SendResult sendResult) {
  62.                 System.out.println("异步发送成功啦" + sendResult);
  63.             }
  64.  
  65.             @Override
  66.             public void onException(Throwable throwable) {
  67.                 System.out.println("异步发送出异常啦" + throwable.getMessage());
  68.             }
  69.         });
  70.  
  71.     }
  72.  
  73.     /**
  74.      * 发送延时消息<br/>
  75.      * 在start版本中 延时消息一共分为18个等级分别为：1s 5s 10s 30s 1m 2m 3m 4m 5m 6m 7m 8m 9m 10m 20m 30m 1h 2h
  76.      */
  77.     public void sendDelay(SceneEnum scene, Object payload, int delayLevel) {
  78.         rocketMQTemplate.syncSend(SceneEnum.destination(scene), MessageBuilder.withPayload(payload).build(), 2000, delayLevel);
  79.     }
  80.  
  81.     /**
  82.      * 发送单向消息（不关心发送结果，如日志）
  83.      */
  84.     public void sendOneWayMsg(SceneEnum scene, Object payload) {
  85.         rocketMQTemplate.sendOneWay(SceneEnum.destination(scene), payload);
  86.     }
  87. }
SceneEnum

这个是场景枚举类，生产中肯定有各种场景定义

  1. package com.example.service.provider.enums;
  2.  
  3. public enum SceneEnum {
  4.     ORDER_CREATE("11000001", "ORDER_CREATE"),
  5.     ORDER_CONFIRM("11000002", "ORDER_CONFIRM"),
  6.     ;
  7.  
  8.     private String sceneCode;
  9.  
  10.     private String desc;
  11.  
  12.     SceneEnum(String sceneCode, String desc) {
  13.         this.sceneCode = sceneCode;
  14.         this.desc = desc;
  15.     }
  16.  
  17.     public String getSceneCode() {
  18.         return sceneCode;
  19.     }
  20.  
  21.     public String getDesc() {
  22.         return desc;
  23.     }
  24.  
  25.     public static String destination(SceneEnum scene) {
  26.  
  27.         String topic = "TP_S_" + scene.getSceneCode().substring(0, 4) + "|" + "EC_EVENT_" + scene.getSceneCode().substring(4, 8);
  28.  
  29.         String tag = scene.getDesc();
  30.  
  31.         return topic + ":" + tag;
  32.     }
  33. }
ProviderController

这个类是我用来测试服务功能的

  1. package com.example.service.provider.controller;
  2.  
  3. import com.example.Order;
  4. import com.example.service.provider.DemoConfig;
  5. import com.example.service.provider.MemberQueryGrpcClient;
  6. import com.example.service.provider.enums.SceneEnum;
  7. import com.example.service.provider.producer.RocketMQProducerService;
  8. import lombok.extern.slf4j.Slf4j;
  9. import org.springframework.beans.factory.annotation.Autowired;
  10. import org.springframework.beans.factory.annotation.Value;
  11. import org.springframework.cloud.context.config.annotation.RefreshScope;
  12. import org.springframework.web.bind.annotation.GetMapping;
  13. import org.springframework.web.bind.annotation.RequestMapping;
  14. import org.springframework.web.bind.annotation.RestController;
  15.  
  16. @RefreshScope
  17. @Slf4j
  18. @RestController
  19. @RequestMapping("/provider")
  20. public class ProviderController {
  21.  
  22.     @Value("${maple-test.message}")
  23.     private String mapleTestMessage;
  24.  
  25.     @Autowired
  26.     private DemoConfig demoConfig;
  27.  
  28.     @Autowired
  29.     private RocketMQProducerService producerService;
  30.  
  31.     @Autowired
  32.     private MemberQueryGrpcClient memberQueryGrpcClient;
  33.  
  34.     @GetMapping("/provider-hello")
  35.     public String sayHello() {
  36.         log.info("hello world");
  37.         return "hello world";
  38.     }
  39.  
  40.     @GetMapping("/grpc/queryMember")
  41.     public String queryMember() {
  42.         log.info("消费服务:service-provider grpc 调用 service-consumer 的 query member 接口");
  43.         return memberQueryGrpcClient.queryMember();
  44.     }
  45.  
  46.     @GetMapping("/sendMq")
  47.     public String sendMq() {
  48.         Order order = new Order();
  49.         order.setOrderName("Apple");
  50.  
  51.         for (int i = 0; i < 5; i++) {
  52.             order.setPrice(i);
  53.             producerService.sendSync(SceneEnum.ORDER_CREATE, order);
  54.         }
  55.  
  56.         return "send message complete";
  57.     }
  58.  
  59.     @GetMapping("/provider-value-config")
  60.     public String valueConfig() {
  61.         log.info("直接@Value获取配置:{}", mapleTestMessage);
  62.         return mapleTestMessage;
  63.     }
  64.  
  65.     @GetMapping("/demo-config")
  66.     public String demoConfig() {
  67.         log.info("通过ConfigurationProperties注解获取配置:{}", demoConfig.getMessage());
  68.         return demoConfig.getMessage();
  69.     }
  70. }
bootstrap.yaml

这个是我们的启动引导配置，所以里面只做了K8s的相关配置

  1. spring:
  2.   application:
  3.     name: service-provider
  4.   cloud:
  5.     kubernetes:
  6.       reload:
  7.         enabled: true #修改K8s的ConfigMap配置之后自动刷新，有默认的刷新策略和刷新时机
  8.       config:
  9.         name: ${spring.application.name} #定义配置文件的名称
  10.         namespace: service-k8s-demo
  11.         sources:
  12.           - name: ${spring.application.name}#真正引用配置文件的名称，根据我们的profile自动找对应的配置文件，该服务专属的配置
  13.             namespace: service-k8s-demo
  14.           - name: service-common-config #一个公共的配置文件，微服务架构中每个服务都可以引用的
  15.             namespace: service-k8s-demo
  16. management:
  17.   endpoint:
  18.     restart:
  19.       enabled: true
  20.     health:
  21.       enabled: true
  22.       probes:
  23.         enabled: true
  24.       show-details: always
  25.     prometheus:
  26.       enabled: true
  27.     info:
  28.       enabled: true
  29.   endpoints:
  30.     web:
  31.       exposure:
  32.         include: '*'
service-provider-start的POM
  1. <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
  2.          xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
  3.     <modelVersion>4.0.0</modelVersion>
  4.     <parent>
  5.         <groupId>com.example</groupId>
  6.         <artifactId>service-provider</artifactId>
  7.         <version>0.0.1-SNAPSHOT</version>
  8.     </parent>
  9.  
  10.     <artifactId>service-provider-start</artifactId>
  11.     <packaging>jar</packaging>
  12.     <name>service-provider-start</name>
  13.  
  14.     <properties>
  15.         <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
  16.     </properties>
  17.  
  18.     <dependencies>
  19.  
  20.         <dependency>
  21.             <groupId>com.example</groupId>
  22.             <artifactId>service-consumer-proto</artifactId>
  23.         </dependency>
  24.         <dependency>
  25.             <groupId>com.example</groupId>
  26.             <artifactId>service-provider-proto</artifactId>
  27.         </dependency>
  28.         <dependency>
  29.             <groupId>com.example</groupId>
  30.             <artifactId>service-provider-dto</artifactId>
  31.         </dependency>
  32.  
  33.         <dependency>
  34.             <groupId>org.springframework.boot</groupId>
  35.             <artifactId>spring-boot-starter</artifactId>
  36.         </dependency>
  37.  
  38.         <dependency>
  39.             <groupId>org.springframework.boot</groupId>
  40.             <artifactId>spring-boot-starter-web</artifactId>
  41.         </dependency>
  42.  
  43.         <dependency>
  44.             <groupId>org.springframework.boot</groupId>
  45.             <artifactId>spring-boot-starter-actuator</artifactId>
  46.         </dependency>
  47.  
  48.         <!-- kubernetes -->
  49.         <dependency>
  50.             <groupId>org.springframework.cloud</groupId>
  51.             <artifactId>spring-cloud-starter-kubernetes-client-all</artifactId>
  52.             <version>2.1.6</version>
  53.             <exclusions>
  54.                 <exclusion>
  55.                     <groupId>com.google.protobuf</groupId>
  56.                     <artifactId>protobuf-java</artifactId>
  57.                 </exclusion>
  58.             </exclusions>
  59.         </dependency>
  60.  
  61.         <!-- RocketMQ -->
  62.         <dependency>
  63.             <groupId>org.apache.rocketmq</groupId>
  64.             <artifactId>rocketmq-spring-boot-starter</artifactId>
  65.             <version>2.2.3</version>
  66.         </dependency>
  67.  
  68.         <dependency>
  69.             <groupId>org.projectlombok</groupId>
  70.             <artifactId>lombok</artifactId>
  71.             <optional>true</optional>
  72.             <version>1.18.26</version>
  73.         </dependency>
  74.  
  75.     </dependencies>
  76.  
  77.     <build>
  78.         <plugins>
  79.             <plugin>
  80.                 <groupId>org.springframework.boot</groupId>
  81.                 <artifactId>spring-boot-maven-plugin</artifactId>
  82.                 <configuration>
  83.                     <classifier>exec</classifier> <!-- 需要打可执行文件 -->
  84.                 </configuration>
  85.             </plugin>
  86.         </plugins>
  87.     </build>
  88. </project>
Dockerfile

在 service-provider-start 模块下面，我们写了个Dockerfile文件，内容很简单。

  1. FROM arm64v8/openjdk:20-slim-buster
  2. ADD service-provider-start-0.0.1-SNAPSHOT-exec.jar service-provider.jar
  3. ENTRYPOINT java -jar  service-provider.jar

config

service-provider-dev.yaml

开发环境的配置文件

  1. apiVersion: v1
  2. kind: ConfigMap
  3. metadata:
  4.   name: service-provider-dev
  5.   namespace: service-k8s-demo
  6.   labels:
  7.     spring.cloud.kubernetes.config: "true"
  8. data:
  9.   application.yml: |-
  10.     spring:
  11.       profiles: dev
  12.     server:
  13.       port: 30000
  14.     grpc:
  15.       server:
  16.         port: 9090
  17.     rocketmq:
  18.       producer:
  19.         group: SERVICE_PRODUCER
  20.       name-server: 124.222.91.116:9876
  21.     bean:
  22.       message: Hello World! --dev
  23.     maple-test:
  24.       message: maple for dev config map in k8s --dev
  25.     redis:
  26.       ip: k8s --dev
service-provider-prod.yaml

生产环境的配置文件

  1. apiVersion: v1
  2. kind: ConfigMap
  3. metadata:
  4.   name: service-provider-prod
  5.   namespace: service-k8s-demo
  6.   labels:
  7.     spring.cloud.kubernetes.config: "true"
  8. data:
  9.   application.yml: |-
  10.     spring:
  11.       profiles: prod
  12.     server:
  13.       port: 30000
  14.     grpc:
  15.       server:
  16.         port: 9090
  17.     rocketmq:
  18.       producer:
  19.         group: SERVICE_PRODUCER
  20.       name-server: 124.222.91.116:9876
  21.     bean:
  22.       message: Hello World! --prod
  23.     maple-test:
  24.       message: maple for dev config map in k8s --prod
  25.     redis:
  26.       ip: k8s --prod
service-common-config.yaml

公共的配置文件，我这里主要是定义了gRpc的服务地址与端口，因为生产中服务是要相互调用的，网上的很多文章把 address: 'dns:///service-consumer:9091' 都写为了 address: 'static://service-consumer:9091'，但是这会导致服务上下线之后，调用方调不到服务的情况，所以采用DNS来动态的发现服务。

  1. apiVersion: v1
  2. kind: ConfigMap
  3. metadata:
  4.   name: service-common-config
  5.   namespace: service-k8s-demo
  6.   labels:
  7.     spring.cloud.kubernetes.config: "true"
  8. data:
  9.   application.yml: |-
  10.     grpc:
  11.       client:
  12.         GLOBAL:
  13.           negotiation-type: plaintext
  14.           enable-keep-alive: true
  15.           keep-alive-without-calls: true
  16.         service-consumer:
  17.           address: 'dns:///service-consumer:9091'
  18.         service-provider:
  19.           address: 'dns:///service-provider:9090'

官网上也给出了下面这种写法来区分不同环境，但是把所有环境都放进一个文件太过臃肿，而且这个文件也不建议太大， 不能超过1M，如果太大就要考虑挂载到磁盘上的目录。

service-provider-deploy.yaml

这个是我们在K8s容器中部署服务的yaml文件

  1. apiVersion: v1
  2. kind: Namespace
  3. metadata:
  4.   name: service-k8s-demo
  5.   labels:
  6.     name: service-k8s-demo
  7.  
  8. ---
  9.  
  10. apiVersion: v1
  11. kind: ServiceAccount
  12. metadata:
  13.   name: service-k8s-demo
  14.   namespace: service-k8s-demo
  15.  
  16. ---
  17.  
  18. kind: ClusterRole
  19. apiVersion: rbac.authorization.k8s.io/v1
  20. metadata:
  21.   namespace: service-k8s-demo
  22.   name: service-k8s-demo
  23. rules:
  24.   - apiGroups:
  25.     - ""
  26.     resources:
  27.     - services
  28.     - configmaps
  29.     - endpoints
  30.     - nodes
  31.     - pods
  32.     - secrets
  33.     - namespaces
  34.     verbs:
  35.     - get
  36.     - list
  37.     - watch
  38.  
  39. ---
  40.  
  41. apiVersion: rbac.authorization.k8s.io/v1
  42. kind: ClusterRoleBinding
  43. metadata:
  44.   name: service-k8s-demo
  45.   namespace: service-k8s-demo
  46. subjects:
  47. - kind: ServiceAccount
  48.   name: service-k8s-demo
  49.   namespace: service-k8s-demo
  50. roleRef:
  51.   kind: ClusterRole
  52.   name: service-k8s-demo
  53.   apiGroup: rbac.authorization.k8s.io
  54.  
  55. ---
  56.  
  57. apiVersion: apps/v1
  58. kind: Deployment
  59. metadata:
  60.   name: service-provider
  61.   namespace: service-k8s-demo
  62.   labels:
  63.     app: service-provider
  64. spec:
  65.   replicas: 3
  66.   template:
  67.     metadata:
  68.       name: service-provider
  69.       labels:
  70.         app: service-provider
  71.     spec:
  72.       containers:
  73.         - name: service-provider
  74.           image: service-provider:1.0
  75.           imagePullPolicy: IfNotPresent
  76.           env:
  77.             - name: SPRING_PROFILES_ACTIVE
  78.               value: "dev"
  79.           ports:
  80.             - name: http
  81.               protocol: TCP
  82.               containerPort: 30000
  83.             - name: grpc
  84.               protocol: TCP
  85.               containerPort: 9090
  86.       serviceAccountName: service-k8s-demo
  87.       restartPolicy: Always
  88.   selector:
  89.     matchLabels:
  90.       app: service-provider
  91.  
  92. ---
  93.  
  94. apiVersion: v1
  95. kind: Service
  96. metadata:
  97.   name: service-provider
  98.   namespace: service-k8s-demo
  99. spec:
  100.   selector:
  101.     app: service-provider
  102.   ports:
  103.     - port: 80
  104.       targetPort: 30000
  105.       name: http
  106.     - port: 9090
  107.       targetPort: 9090
  108.       name: grpc
  109.   type: NodePort

你可以发现我在这里指定了个profiles，实际生产中可以有两份yaml文件，也可以一份yaml文件，把profile给动态传进来，这个我之后再研究过来更新吧。

service-gateway.yaml

这个是Envoy充当南北向网关的，负责请求的转发和限流等，我这里目前是测试了转发，限流后面测试完成再过来更新。

  1. apiVersion: networking.istio.io/v1alpha3
  2. kind: Gateway
  3. metadata:
  4.   name: service-k8s-demo-gateway
  5.   namespace: service-k8s-demo
  6. spec:
  7.   selector:
  8.     istio: ingressgateway # use istio default controller
  9.   servers:
  10.   - port:
  11.       number: 31400
  12.       name: http
  13.       protocol: HTTP
  14.     hosts:
  15.     - "*"
  16. ---
  17. apiVersion: networking.istio.io/v1alpha3
  18. kind: VirtualService
  19. metadata:
  20.   name: service-k8s-demo-virtual-service
  21.   namespace: service-k8s-demo
  22. spec:
  23.   hosts:
  24.   - "*"
  25.   gateways:
  26.   - service-k8s-demo-gateway
  27.   http:
  28.   - match:
  29.     - uri:
  30.         prefix: /consumer
  31.     route:
  32.     - destination:
  33.         host: service-consumer
  34.         port:
  35.           number: 80
  36.   - match:
  37.     - uri:
  38.         prefix: /provider
  39.     route:
  40.     - destination:
  41.         host: service-provider
  42.         port:
  43.           number: 80

至此为止，我们的 service-provider 模块的代码都已经全部完成了，不要妄想本地能跑起来哈，因为我们是在yaml文件里指定的profile，所以必须在K8s中执行yaml文件才能让他自动把帮我们去找config文件的，不过可以试着启动看看有没有什么报错，我本地启动是报这俩错，这是因为我们本地没有和K8s打交道，导致没有K8s的环境，所以也找不到配置类，报了RocketMQ的错，但是没有关系，等我们使用K8s时这些问题都没有了。

service-consumer

工程结构

最外层POM

  1. <?xml version="1.0" encoding="UTF-8"?>
  2. <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
  3.          xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 https://maven.apache.org/xsd/maven-4.0.0.xsd">
  4.     <modelVersion>4.0.0</modelVersion>
  5.     <parent>
  6.         <groupId>org.springframework.boot</groupId>
  7.         <artifactId>spring-boot-starter-parent</artifactId>
  8.         <version>2.7.9</version>
  9.         <relativePath/> <!-- lookup parent from repository -->
  10.     </parent>
  11.     <groupId>com.example</groupId>
  12.     <artifactId>service-consumer</artifactId>
  13.     <version>0.0.1-SNAPSHOT</version>
  14.     <packaging>pom</packaging>
  15.     <name>service-consumer</name>
  16.     <description>service-consumer</description>
  17.     <modules>
  18.         <module>service-consumer-proto</module>
  19.         <module>service-consumer-start</module>
  20.     </modules>
  21.     <properties>
  22.         <java.version>17</java.version>
  23.     </properties>
  24.     <dependencyManagement>
  25.         <dependencies>
  26.             <dependency>
  27.                 <groupId>org.springframework.boot</groupId>
  28.                 <artifactId>spring-boot-dependencies</artifactId>
  29.                 <type>pom</type>
  30.                 <scope>import</scope>
  31.                 <version>2.7.9</version>
  32.             </dependency>
  33.  
  34.             <dependency>
  35.                 <groupId>com.example</groupId>
  36.                 <artifactId>service-consumer-proto</artifactId>
  37.                 <version>0.0.1-SNAPSHOT</version>
  38.             </dependency>
  39.             <dependency>
  40.                 <groupId>com.example</groupId>
  41.                 <artifactId>service-provider-proto</artifactId>
  42.                 <version>0.0.1-SNAPSHOT</version>
  43.             </dependency>
  44.             <dependency>
  45.                 <groupId>com.example</groupId>
  46.                 <artifactId>service-provider-dto</artifactId>
  47.                 <version>0.0.1-SNAPSHOT</version>
  48.             </dependency>
  49.         </dependencies>
  50.     </dependencyManagement>
  51.  
  52. </project>

service-consumer-proto

  1. syntax = "proto3";
  2.  
  3. option java_multiple_files = true;
  4. option java_package = "com.example.service.consumer.api";
  5. option java_outer_classname = "MemberQueryServiceProto";
  6.  
  7. service MemberQueryService {
  8.   rpc queryMember (MemberQueryRequest) returns (MemberQueryResponse) {
  9.   }
  10. }
  11.  
  12. message MemberQueryRequest {
  13.   string memberId = 1;
  14.   string username = 2;
  15. }
  16.  
  17. message MemberQueryResponse {
  18.   int32 code = 1;
  19.   string message = 2;
  20.   bool success = 3;
  21.   MemberQueryData data = 4;
  22. }
  23.  
  24. message MemberQueryData {
  25.   string memberId = 1;
  26.   string username = 2;
  27.   int32 age = 3;
  28.   repeated AddressData address = 4;
  29.   map<string, string> extMap = 5;
  30. }
  31.  
  32. message AddressData {
  33.   string address = 1;
  34.   string phone = 2;
  35. }
  1. <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
  2.          xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
  3.     <modelVersion>4.0.0</modelVersion>
  4.  
  5.     <parent>
  6.         <artifactId>service-consumer</artifactId>
  7.         <groupId>com.example</groupId>
  8.         <version>0.0.1-SNAPSHOT</version>
  9.     </parent>
  10.  
  11.     <groupId>com.example</groupId>
  12.     <artifactId>service-consumer-proto</artifactId>
  13.     <version>0.0.1-SNAPSHOT</version>
  14.     <packaging>jar</packaging>
  15.  
  16.     <name>service-consumer-proto</name>
  17.  
  18.     <properties>
  19.         <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
  20.     </properties>
  21.  
  22.     <dependencies>
  23.         <!-- gRpc -->
  24.         <dependency>
  25.             <groupId>net.devh</groupId>
  26.             <artifactId>grpc-spring-boot-starter</artifactId>
  27.             <version>2.14.0.RELEASE</version>
  28.         </dependency>
  29.         <dependency>
  30.             <groupId>io.grpc</groupId>
  31.             <artifactId>grpc-protobuf</artifactId>
  32.             <version>1.52.1</version>
  33.         </dependency>
  34.         <dependency> <!-- necessary for Java 9+ -->
  35.             <groupId>org.apache.tomcat</groupId>
  36.             <artifactId>annotations-api</artifactId>
  37.             <version>6.0.53</version>
  38.         </dependency>
  39.     </dependencies>
  40.  
  41.     <build>
  42.         <extensions>
  43.             <extension>
  44.                 <groupId>kr.motd.maven</groupId>
  45.                 <artifactId>os-maven-plugin</artifactId>
  46.                 <version>1.7.1</version>
  47.             </extension>
  48.         </extensions>
  49.         <plugins>
  50.             <plugin>
  51.                 <groupId>org.xolstice.maven.plugins</groupId>
  52.                 <artifactId>protobuf-maven-plugin</artifactId>
  53.                 <version>0.6.1</version>
  54.                 <configuration>
  55.                     <protocArtifact>com.google.protobuf:protoc:3.21.7:exe:${os.detected.classifier}</protocArtifact>
  56.                     <pluginId>grpc-java</pluginId>
  57.                     <pluginArtifact>io.grpc:protoc-gen-grpc-java:1.52.1:exe:${os.detected.classifier}</pluginArtifact>
  58.                 </configuration>
  59.                 <executions>
  60.                     <execution>
  61.                         <goals>
  62.                             <goal>compile</goal>
  63.                             <goal>compile-custom</goal>
  64.                         </goals>
  65.                     </execution>
  66.                 </executions>
  67.             </plugin>
  68.         </plugins>
  69.     </build>
  70. </project>

service-consumer-start

POM
  1. <?xml version="1.0" encoding="UTF-8"?>
  2. <project xmlns="http://maven.apache.org/POM/4.0.0"
  3.          xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
  4.          xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
  5.     <modelVersion>4.0.0</modelVersion>
  6.     <parent>
  7.         <groupId>com.example</groupId>
  8.         <artifactId>service-consumer</artifactId>
  9.         <version>0.0.1-SNAPSHOT</version>
  10.     </parent>
  11.  
  12.     <artifactId>service-consumer-start</artifactId>
  13.  
  14.     <properties>
  15.         <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
  16.     </properties>
  17.  
  18.     <dependencies>
  19.  
  20.         <dependency>
  21.             <groupId>com.example</groupId>
  22.             <artifactId>service-provider-proto</artifactId>
  23.         </dependency>
  24.         <dependency>
  25.             <groupId>com.example</groupId>
  26.             <artifactId>service-consumer-proto</artifactId>
  27.         </dependency>
  28.         <dependency>
  29.             <groupId>com.example</groupId>
  30.             <artifactId>service-provider-dto</artifactId>
  31.         </dependency>
  32.  
  33.         <dependency>
  34.             <groupId>org.springframework.boot</groupId>
  35.             <artifactId>spring-boot-starter</artifactId>
  36.         </dependency>
  37.  
  38.         <dependency>
  39.             <groupId>org.springframework.boot</groupId>
  40.             <artifactId>spring-boot-starter-web</artifactId>
  41.         </dependency>
  42.  
  43.         <dependency>
  44.             <groupId>org.springframework.boot</groupId>
  45.             <artifactId>spring-boot-starter-actuator</artifactId>
  46.         </dependency>
  47.  
  48.         <!-- kubernetes -->
  49.         <dependency>
  50.             <groupId>org.springframework.cloud</groupId>
  51.             <artifactId>spring-cloud-starter-kubernetes-client-all</artifactId>
  52.             <version>2.1.6</version>
  53.             <exclusions>
  54.                 <exclusion>
  55.                     <groupId>com.google.protobuf</groupId>
  56.                     <artifactId>protobuf-java</artifactId>
  57.                 </exclusion>
  58.             </exclusions>
  59.         </dependency>
  60.  
  61.         <!-- RocketMQ -->
  62.         <dependency>
  63.             <groupId>org.apache.rocketmq</groupId>
  64.             <artifactId>rocketmq-spring-boot-starter</artifactId>
  65.             <version>2.2.3</version>
  66.         </dependency>
  67.  
  68.         <dependency>
  69.             <groupId>org.projectlombok</groupId>
  70.             <artifactId>lombok</artifactId>
  71.             <optional>true</optional>
  72.             <version>1.18.26</version>
  73.         </dependency>
  74.     </dependencies>
  75.  
  76.     <build>
  77.         <plugins>
  78.             <plugin>
  79.                 <groupId>org.springframework.boot</groupId>
  80.                 <artifactId>spring-boot-maven-plugin</artifactId>
  81.                 <configuration>
  82.                     <classifier>exec</classifier>
  83.                 </configuration>
  84.             </plugin>
  85.         </plugins>
  86.     </build>
  87.  
  88. </project>
MemberQueryServiceImpl

这个是 service-consumer 暴露接口的实现类

  1. package com.example.service.consumer.facade;
  2.  
  3. import com.example.service.consumer.api.*;
  4. import com.google.common.collect.Maps;
  5. import lombok.extern.slf4j.Slf4j;
  6. import net.devh.boot.grpc.server.service.GrpcService;
  7.  
  8. import java.util.ArrayList;
  9. import java.util.List;
  10. import java.util.Map;
  11.  
  12. @Slf4j
  13. @GrpcService
  14. public class MemberQueryServiceImpl extends MemberQueryServiceGrpc.MemberQueryServiceImplBase {
  15.  
  16.     @Override
  17.     public void queryMember(MemberQueryRequest request, io.grpc.stub.StreamObserver<MemberQueryResponse> responseObserver) {
  18.         log.info("接收其他服务的 query member 的 grpc 请求, 请求参数为:{}", request);
  19.         List<AddressData> addressList = new ArrayList<>();
  20.         addressList.add(AddressData.newBuilder().setAddress("杭州").setPhone("110").build());
  21.         addressList.add(AddressData.newBuilder().setAddress("马来西亚").setPhone("911").build());
  22.  
  23.         Map<String, String> extMap = Maps.newHashMap();
  24.         extMap.put("secondField", "2");
  25.         extMap.put("lastField", "last");
  26.  
  27.         MemberQueryData queryData = MemberQueryData.newBuilder()
  28.                 .setMemberId(request.getMemberId())
  29.                 .setUsername(request.getUsername())
  30.                 .setAge(18)
  31.                 .addAllAddress(addressList)
  32.                 .putExtMap("firstField", "test-maple")
  33.                 .putAllExtMap(extMap)
  34.                 .build();
  35.  
  36.         MemberQueryResponse.Builder builder = MemberQueryResponse.newBuilder()
  37.                 .setCode(0)
  38.                 .setMessage("success")
  39.                 .setSuccess(true)
  40.                 .setData(queryData);
  41.  
  42.         responseObserver.onNext(builder.build());
  43.         responseObserver.onCompleted();
  44.     }
  45. }
ServiceConsumerApplication
  1. package com.example.service.consumer;
  2.  
  3. import org.springframework.boot.SpringApplication;
  4. import org.springframework.boot.autoconfigure.SpringBootApplication;
  5. import org.springframework.cloud.client.discovery.EnableDiscoveryClient;
  6.  
  7. @EnableDiscoveryClient
  8. @SpringBootApplication
  9. public class ServiceConsumerApplication {
  10.  
  11.     public static void main(String[] args) {
  12.         SpringApplication.run(ServiceConsumerApplication.class, args);
  13.     }
  14. }
CreateOrderGotoneConsumer

这个是消费订单创建的消息，然后给用户发送通知的

  1. package com.example.service.consumer.mq;
  2.  
  3. import com.alibaba.fastjson.JSON;
  4. import com.example.Order;
  5. import lombok.extern.slf4j.Slf4j;
  6. import org.apache.rocketmq.spring.annotation.RocketMQMessageListener;
  7. import org.apache.rocketmq.spring.core.RocketMQListener;
  8. import org.springframework.stereotype.Component;
  9.  
  10. /**
  11.  * 创建订单成功，发送gotone通知
  12.  */
  13. @Slf4j
  14. @Component
  15. @RocketMQMessageListener(topic = "TP_S_1100|EC_EVENT_0001", consumerGroup = "CREATE_ORDER_GOTONE_CONSUMER")
  16. public class CreateOrderGotoneConsumer implements RocketMQListener<Order> {
  17.     @Override
  18.     public void onMessage(Order order) {
  19.         log.info("consumer message: 【CreateOrderGotoneConsumer】,【{}】", JSON.toJSONString(order));
  20.     }
  21. }
DeductInventoryConsumer

这个也是消费订单创建的消息，扣减库存的，这两个是不同的consumerGroup，所以都能消费到消息，但是这个情况一定要做好幂等处理，访问其中一个consumerGroup消费失败触发重试一直投递消息，导致处理成功的consumerGroup也一直收到消息，所以要做好幂等。

  1. package com.example.service.consumer.mq;
  2.  
  3. import com.alibaba.fastjson.JSON;
  4. import com.example.Order;
  5. import lombok.extern.slf4j.Slf4j;
  6. import org.apache.rocketmq.spring.annotation.RocketMQMessageListener;
  7. import org.apache.rocketmq.spring.core.RocketMQListener;
  8. import org.springframework.stereotype.Component;
  9.  
  10. /**
  11.  * 创建订单成功，扣减库存
  12.  */
  13. @Slf4j
  14. @Component
  15. @RocketMQMessageListener(topic = "TP_S_1100|EC_EVENT_0001", consumerGroup = "DEDUCT_INVENTORY_CONSUMER")
  16. public class DeductInventoryConsumer implements RocketMQListener<Order> {
  17.     @Override
  18.     public void onMessage(Order order) {
  19.         log.info("consumer message: 【DeductInventoryConsumer】,【{}】", JSON.toJSONString(order));
  20.     }
  21. }
ProviderServiceGrpcClient

这个是 service-consumer 调用 service-provider 的gRpc 接口

  1. package com.example.service.consumer.grpc;
  2.  
  3. import com.example.service.provider.api.HelloServiceGrpc;
  4. import com.example.service.provider.api.SayHelloRequest;
  5. import com.example.service.provider.api.SayHelloResponse;
  6. import net.devh.boot.grpc.client.inject.GrpcClient;
  7. import org.springframework.stereotype.Service;
  8.  
  9. @Service
  10. public class ProviderServiceGrpcClient {
  11.  
  12.     @GrpcClient("service-provider")
  13.     private HelloServiceGrpc.HelloServiceBlockingStub helloServiceBlockingStub;
  14.  
  15.     public String sayHello() {
  16.  
  17.         SayHelloRequest request = SayHelloRequest.newBuilder().setName("maple123").build();
  18.  
  19.         SayHelloResponse sayHelloResponse = helloServiceBlockingStub.sayHello(request);
  20.  
  21.         return sayHelloResponse.toString();
  22.     }
  23. }
ConsumerController

这个是测试consumer服务的入口

  1. package com.example.service.consumer.controller;
  2.  
  3. import com.example.service.consumer.grpc.ProviderServiceGrpcClient;
  4. import com.example.service.consumer.ServiceConsumerApplication;
  5. import lombok.RequiredArgsConstructor;
  6. import lombok.extern.slf4j.Slf4j;
  7. import org.springframework.beans.factory.annotation.Value;
  8. import org.springframework.boot.SpringApplication;
  9. import org.springframework.cloud.client.discovery.DiscoveryClient;
  10. import org.springframework.cloud.context.config.annotation.RefreshScope;
  11. import org.springframework.web.bind.annotation.GetMapping;
  12. import org.springframework.web.bind.annotation.RequestMapping;
  13. import org.springframework.web.bind.annotation.RestController;
  14.  
  15. import java.util.List;
  16.  
  17. @Slf4j
  18. @RequiredArgsConstructor
  19. @RefreshScope
  20. @RestController
  21. @RequestMapping("/consumer")
  22. public class ConsumerController {
  23.  
  24.     private final DiscoveryClient discoveryClient;
  25.     private final ProviderServiceGrpcClient providerServiceGrpcClient;
  26.  
  27.     public static void main(String[] args) {
  28.         SpringApplication.run(ServiceConsumerApplication.class, args);
  29.     }
  30.  
  31.     @Value("${consumer.body}")
  32.     private String consumerBody;
  33.  
  34.     @GetMapping("/grpc/hello")
  35.     public String sayHello() {
  36.         log.info("消费服务:service-consumer grpc 调用 service-provider");
  37.         return providerServiceGrpcClient.sayHello();
  38.     }
  39.  
  40.     @GetMapping("/consumerBody")
  41.     public String consumerBody() {
  42.         log.info("获取配置consumerBody:{}", consumerBody);
  43.         return consumerBody;
  44.     }
  45.  
  46.     @GetMapping("/consumers/services")
  47.     public List<String> findServices() {
  48.         log.info("当前注册中心下所有服务");
  49.         List<String> services = discoveryClient.getServices();
  50.         services.stream().map(discoveryClient::getInstances).forEach(v ->
  51.                 v.forEach(s -> System.out.printf("%s:%s  uri:%s%n", s.getHost(), s.getPort(), s.getUri())));
  52.  
  53.         return services;
  54.     }
  55. }
bootstrap.yaml

这个是 service-consumer 的引导类配置，也放了rocketmq 的配置进来，因为对于消费者它启动的时候就会去初始化consumer。

  1. spring:
  2.   application:
  3.     name: service-consumer
  4.   cloud:
  5.     kubernetes:
  6.       reload:
  7.         enabled: true
  8.       config:
  9.         name: ${spring.application.name}
  10.         namespace: service-k8s-demo
  11.         sources:
  12.           - name: ${spring.application.name}
  13.             namespace: service-k8s-demo
  14.           - name: service-common-config
  15.             namespace: service-k8s-demo
  16.  
  17. management:
  18.   endpoint:
  19.     restart:
  20.       enabled: true
  21.     health:
  22.       enabled: true
  23.     info:
  24.       enabled: true
  25.   endpoints:
  26.     web:
  27.       exposure:
  28.         include: '*'
  29. rocketmq:
  30.   name-server: 124.222.91.116:9876
Dockerfile
  1. FROM arm64v8/openjdk:20-slim-buster
  2. ADD service-consumer-start-0.0.1-SNAPSHOT-exec.jar service-consumer.jar
  3. ENTRYPOINT java -jar  service-consumer.jar

config

service-consumer-dev.yaml
  1. apiVersion: v1
  2. kind: ConfigMap
  3. metadata:
  4.   name: service-consumer-dev
  5.   namespace: service-k8s-demo
  6.   labels:
  7.     spring.cloud.kubernetes.config: "true"
  8. data:
  9.   application.yml: |-
  10.     spring:
  11.       profiles: dev
  12.     server:
  13.       port: 30001
  14.     grpc:
  15.       server:
  16.         port: 9091
  17.     consumer:
  18.       body: "1234567890--dev"
service-consumer-prod.yaml
  1. apiVersion: v1
  2. kind: ConfigMap
  3. metadata:
  4.   name: service-consumer-prod
  5.   namespace: service-k8s-demo
  6.   labels:
  7.     spring.cloud.kubernetes.config: "true"
  8. data:
  9.   application.yml: |-
  10.     spring:
  11.       profiles: prod
  12.     server:
  13.       port: 30001
  14.     grpc:
  15.       server:
  16.         port: 9091
  17.     consumer:
  18.       body: "1234567890--prod"

service-consumer-deploy.yaml

  1. apiVersion: v1
  2. kind: Namespace
  3. metadata:
  4.   name: service-k8s-demo
  5.   labels:
  6.     name: service-k8s-demo
  7.  
  8. ---
  9.  
  10. apiVersion: v1
  11. kind: ServiceAccount
  12. metadata:
  13.   name: service-k8s-demo
  14.   namespace: service-k8s-demo
  15.  
  16. ---
  17.  
  18. kind: ClusterRole
  19. apiVersion: rbac.authorization.k8s.io/v1
  20. metadata:
  21.   namespace: service-k8s-demo
  22.   name: service-k8s-demo
  23. rules:
  24.   - apiGroups:
  25.       - ""
  26.     resources:
  27.       - services
  28.       - configmaps
  29.       - endpoints
  30.       - nodes
  31.       - pods
  32.       - secrets
  33.       - namespaces
  34.     verbs:
  35.       - get
  36.       - list
  37.       - watch
  38.  
  39. ---
  40.  
  41. apiVersion: rbac.authorization.k8s.io/v1
  42. kind: ClusterRoleBinding
  43. metadata:
  44.   name: service-k8s-demo
  45.   namespace: service-k8s-demo
  46. subjects:
  47.   - kind: ServiceAccount
  48.     name: service-k8s-demo
  49.     namespace: service-k8s-demo
  50. roleRef:
  51.   kind: ClusterRole
  52.   name: service-k8s-demo
  53.   apiGroup: rbac.authorization.k8s.io
  54.  
  55. ---
  56.  
  57. apiVersion: apps/v1
  58. kind: Deployment
  59. metadata:
  60.   name: service-consumer
  61.   namespace: service-k8s-demo
  62.   labels:
  63.     app: service-consumer
  64. spec:
  65.   replicas: 1
  66.   template:
  67.     metadata:
  68.       name: service-consumer
  69.       labels:
  70.         app: service-consumer
  71.     spec:
  72.       containers:
  73.         - name: service-consumer
  74.           image: service-consumer:1.0
  75.           imagePullPolicy: IfNotPresent
  76.           env:
  77.             - name: SPRING_PROFILES_ACTIVE
  78.               value: "prod"
  79.           ports:
  80.             - name: http
  81.               protocol: TCP
  82.               containerPort: 30001
  83.             - name: grpc
  84.               protocol: TCP
  85.               containerPort: 9091
  86.       serviceAccountName: service-k8s-demo
  87.       restartPolicy: Always
  88.   selector:
  89.     matchLabels:
  90.       app: service-consumer
  91.  
  92. ---
  93.  
  94. apiVersion: v1
  95. kind: Service
  96. metadata:
  97.   name: service-consumer
  98.   namespace: service-k8s-demo
  99. spec:
  100.   selector:
  101.     app: service-consumer
  102.   ports:
  103.     - port: 80
  104.       targetPort: 30001
  105.       name: http
  106.     - port: 9091
  107.       targetPort: 9091
  108.       name: grpc
  109.   type: NodePort

至此为止，我们的 service-consumer 模块的代码也都已经全部完成了。

部署

0. 准备环境：docker、K8s、Istio

  1. service-provider 和 service-consumer 打镜像，我这里直接打到本地仓库，这里是docker的范畴（docker build -t service-provider:1.0 . 等）

  1. 把 service-provider 和 service-consumer 的 config 都在K8s容器中执行，这里是K8s的范畴（kubectl apply -f service-consumer-dev.yaml 等）

  1. 把 service-provider 和 service-consumer 部署到 K8s 容器中，这里是K8s的范畴（kubectl apply -f service-consumer-deploy.yaml 等），部署完成之后我们查看一下相关的pod，service，config等

  1. 这个时候两个服务的端口都有了，就可以使用controller里的rest接口相互进行测试了，可以测试下service-consumer调用service-provide的gRpc接口，可以发现 service-provide 虽然有3台但全打在了一个POD上，这个是因为gRpc是基于HTTP2.0多路复用，L4层基于连接级别的负载均衡，在K8s中负载均衡是失效的，需要借助L7应用层负载均衡来做，Envoy和Linkerd等可以实现，Linkerd实现起来很简单，可以点这里。

  1. 把我们的namespace 注入到 Envoy 中

kubectl label namespace service-k8s-demo istio-injection=enabled

  1. 启动Istio dashboard Kiali

istioctl dashboard kiali &

  1. 做测试，我的Gateway里的端口是31400

测试gRpc相互调用，同时也关注下负载均衡的问题，这里解决了。

测试RocketMQ 生产消费

测试动态配置

至此，测试完成。

声明：本文内容由网友自发贡献，不代表【wpsshop博客】立场，版权归原作者所有，本站不承担相应法律责任。如您发现有侵权的内容，请联系我们。转载请注明出处：https://www.wpsshop.cn/w/我家自动化/article/detail/181648
推荐阅读
相关标签

Copyright © 2003-2013 www.wpsshop.cn 版权所有，并保留所有权利。

  

闽ICP备14008679号