Git Product home page Git Product logo

spring-cloud-rsocket's People

Contributors

ryanjbaxter avatar spencergibb avatar spring-builds avatar spring-operator avatar trevormarshall avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

spring-cloud-rsocket's Issues

Routing Based On Route Metadata Tags Not Working Properly

I am using ...
Spring Boot: 2.2.0.RELEASE
Spring Cloud: Hoxton.BUILD-SNAPSHOT
Spring Cloud RSocket: 0.2.0.BUILD-SNAPSHOT
Sample project: here

In my setup reservation-service-client communicates with reservation-service via RSocket and the service-gateway.

reservation-service registers with the following route metadata tags (see reservation-service/src/main/resources/application.yml):

spring:
  cloud:
    gateway:
      rsocket:
        client:
          service-name: reservation-service
          route-id: 400
          tags: 
            instance_name: reservation-service-1
            version: 1.0-RELEASE  # <-- I want to route based on that version.
          broker: 
            host: localhost
            port: 7002     

reservation-service-client declares forwarding information like that(see reservation-service-client/src/main/resources/application.yml):

spring:
  cloud:
    gateway:
      rsocket:
        client:
          service-name: reservation-service-client
          route-id: 500
          forwarding:       # Routing / forwarding hints to the Gateway broker.
            "[create.reservation.{vrsn}]":
              service_name: reservation-service
              version:      "{vrsn}-RELEASE"

... where {vrsn} is resolved to 2.0 as coded in reservation-service-client's ReservationServiceClient like so:

public Mono<ReservationConfirmation> createReservation(CreateReservationRequest request) {
    String version = "2.0";
    return rsocketRequester.route("create.reservation.{vrsn}", version) 
                    .data(request)
                    .retrieveMono(ReservationConfirmation.class)
                    .log();
  }

Thus, the client should be forwarded to a reservation-service instance of version 2.0-RELEASE (which is not available). However, that is not the case, and client is getting forwarded to a service instance of version 1.0-RELEASE.

When the client sends the request via the gateway to the service, you can see output in the gateway logs, that the forwarding metadata is properly available and {vrsn} was resolved properly as well, yet the gateway simply forwards to the reservation-service instance of version 1.0-RELEASE although the client routing metadata states otherwise.

Expected behaviour in this case (imo) would be to respond with max backpressure from the gateway since the service is not (yet) available.

To reproduce:

  1. start service-gateway
  2. start reservation-service
  3. start reservation-service-client
  4. send a POST request to http://localhost:9999/reservation/create/ReservationName (Web endpoint of client that will send the RSocket request)

How can I connect to the gateway via JavaScript webclient?

Hi,

I'm using rsocket-websocket-client to connect to the gateway. However, I always get this particular exception since I do not set a routeId in my client.

java.lang.NullPointerException: null at java.base/java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:936) ~[na:na] Suppressed: reactor.core.publisher.FluxOnAssembly$OnAssemblyException: Assembly trace from producer [reactor.core.publisher.MonoDefer] : reactor.core.publisher.Mono.defer org.springframework.cloud.gateway.rsocket.filter.AbstractFilterChain.filter(AbstractFilterChain.java:104) Error has been observed at the following site(s): |_ Mono.defer ⇢ at org.springframework.cloud.gateway.rsocket.filter.AbstractFilterChain.filter(AbstractFilterChain.java:104) |_ Mono.log ⇢ at org.springframework.cloud.gateway.rsocket.socketacceptor.GatewaySocketAcceptor.accept(GatewaySocketAcceptor.java:113) |_ Mono.map ⇢ at org.springframework.cloud.gateway.rsocket.socketacceptor.GatewaySocketAcceptor.accept(GatewaySocketAcceptor.java:115) |_ Mono.then ⇢ at io.rsocket.RSocketFactory$ServerRSocketFactory$ServerStart.lambda$null$3(RSocketFactory.java:674) |_ Mono.onErrorResume ⇢ at io.rsocket.RSocketFactory$ServerRSocketFactory$ServerStart.lambda$acceptSetup$6(RSocketFactory.java:673) ...

I do not want users of the webclients to register themselves as separate microservices. How can I bypass the GatewaySocketAcceptor such that webclients are exempted from adding themselves in the RoutingTable?

Thank you in advance! And I'm terribly sorry if this is the wrong place for this type of question. I would use stackoverflow but it seems as though there is no way to accomplish what I'm looking for, currently.

Nullpointer for tagsMetadata in Gateway RSocket Broker

@FWinkler79 said:
I am using ...
Spring Boot: 2.2.0.RELEASE
Spring Cloud: Hoxton.BUILD-SNAPSHOT
Sample project: here

My setup is as follows:

  1. service-gateway is an RSocket broker-enabed SCG
  2. reservation-service exposes an RSocket endpoint to create a reservation
  3. reservation-service-client exposes a Web-endpoint (WebFlux-based) to POST a reservation-creation request, which will be translated into an RSocket-request. The request should traverse gateway and reach reservation-service
  4. The reservation-service-client uses declarative forwarding / routing metadata in its application.yml

When running this setup, I receive the following NullPointerException in SCG:

Found routes: [[RoutingTableRoutes.RegistryRoute@45d46254 id = '1', predicate = [RoutIdPredicate 1]], [RoutingTableRoutes.RegistryRoute@294b114a id = '400', predicate = [RoutIdPredicate 400]], [RoutingTableRoutes.RegistryRoute@19d2ef80 id = '500', predicate = [RoutIdPredicate 500]]]
2019-10-21 17:39:12.705 DEBUG 20703 --- [ctor-http-nio-3] o.s.c.g.rsocket.core.GatewayRSocket      : Unable to find destination RSocket for null
2019-10-21 17:39:12.705 DEBUG 20703 --- [ctor-http-nio-3] o.s.c.g.r.core.PendingRequestRSocket     : creating pending RSocket for null
2019-10-21 17:39:12.714 ERROR 20703 --- [ctor-http-nio-3] o.s.cloud.gateway.rsocket.route.Routes   : Error applying predicate for route: 1

java.lang.NullPointerException: null
	at org.springframework.cloud.gateway.rsocket.routing.RoutingTable.find(RoutingTable.java:194) ~[spring-cloud-gateway-rsocket-broker-2.2.0.BUILD-SNAPSHOT.jar:2.2.0.BUILD-SNAPSHOT]
	at org.springframework.cloud.gateway.rsocket.routing.RoutingTable.findRouteIds(RoutingTable.java:154) ~[spring-cloud-gateway-rsocket-broker-2.2.0.BUILD-SNAPSHOT.jar:2.2.0.BUILD-SNAPSHOT]
	at org.springframework.cloud.gateway.rsocket.routing.RoutingTableRoutes$RoutIdPredicate.apply(RoutingTableRoutes.java:108) ~[spring-cloud-gateway-rsocket-broker-2.2.0.BUILD-SNAPSHOT.jar:2.2.0.BUILD-SNAPSHOT]
	at org.springframework.cloud.gateway.rsocket.routing.RoutingTableRoutes$RoutIdPredicate.apply(RoutingTableRoutes.java:92) ~[spring-cloud-gateway-rsocket-broker-2.2.0.BUILD-SNAPSHOT.jar:2.2.0.BUILD-SNAPSHOT]
	at org.springframework.cloud.gateway.rsocket.route.Routes.lambda$null$0(Routes.java:45) ~[spring-cloud-gateway-rsocket-broker-2.2.0.BUILD-SNAPSHOT.jar:2.2.0.BUILD-SNAPSHOT]
	at reactor.core.publisher.MonoFilterWhen$MonoFilterWhenMain.onNext(MonoFilterWhen.java:116) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.Operators$ScalarSubscription.request(Operators.java:2148) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.MonoFilterWhen$MonoFilterWhenMain.onSubscribe(MonoFilterWhen.java:103) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.MonoJust.subscribe(MonoJust.java:54) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.Mono.subscribe(Mono.java:4087) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxConcatMap$ConcatMapImmediate.drain(FluxConcatMap.java:441) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxConcatMap$ConcatMapImmediate.onSubscribe(FluxConcatMap.java:211) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxIterable.subscribe(FluxIterable.java:139) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxIterable.subscribe(FluxIterable.java:63) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.InternalMonoOperator.subscribe(InternalMonoOperator.java:55) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:52) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at io.rsocket.RSocketResponder.handleRequestResponse(RSocketResponder.java:387) ~[rsocket-core-1.0.0-RC5.jar:na]
	at io.rsocket.RSocketResponder.handleFrame(RSocketResponder.java:299) ~[rsocket-core-1.0.0-RC5.jar:na]
	at reactor.core.publisher.LambdaSubscriber.onNext(LambdaSubscriber.java:160) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:192) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.MonoFlatMapMany$FlatMapManyInner.onNext(MonoFlatMapMany.java:242) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxGroupBy$UnicastGroupedFlux.drainRegular(FluxGroupBy.java:554) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxGroupBy$UnicastGroupedFlux.drain(FluxGroupBy.java:630) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxGroupBy$UnicastGroupedFlux.subscribe(FluxGroupBy.java:696) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.Flux.subscribe(Flux.java:8134) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.MonoFlatMapMany$FlatMapManyMain.onNext(MonoFlatMapMany.java:188) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1592) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.MonoProcessor.onNext(MonoProcessor.java:317) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at io.rsocket.internal.ClientServerInputMultiplexer.lambda$new$1(ClientServerInputMultiplexer.java:116) ~[rsocket-core-1.0.0-RC5.jar:na]
	at reactor.core.publisher.LambdaSubscriber.onNext(LambdaSubscriber.java:160) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxGroupBy$GroupByMain.drainLoop(FluxGroupBy.java:380) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxGroupBy$GroupByMain.drain(FluxGroupBy.java:316) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxGroupBy$GroupByMain.onNext(FluxGroupBy.java:201) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:192) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxMap$MapSubscriber.onNext(FluxMap.java:114) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxMap$MapSubscriber.onNext(FluxMap.java:114) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.netty.channel.FluxReceive.drainReceiver(FluxReceive.java:206) ~[reactor-netty-0.9.0.RELEASE.jar:0.9.0.RELEASE]
	at reactor.netty.channel.FluxReceive.onInboundNext(FluxReceive.java:329) ~[reactor-netty-0.9.0.RELEASE.jar:0.9.0.RELEASE]
	at reactor.netty.channel.ChannelOperations.onInboundNext(ChannelOperations.java:348) ~[reactor-netty-0.9.0.RELEASE.jar:0.9.0.RELEASE]
	at reactor.netty.channel.ChannelOperationsHandler.channelRead(ChannelOperationsHandler.java:91) ~[reactor-netty-0.9.0.RELEASE.jar:0.9.0.RELEASE]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:328) ~[netty-codec-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:302) ~[netty-codec-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044) ~[netty-common-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[netty-common-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[netty-common-4.1.42.Final.jar:4.1.42.Final]
	at java.base/java.lang.Thread.run(Thread.java:834) ~[na:na]

2019-10-21 17:39:12.715 ERROR 20703 --- [ctor-http-nio-3] o.s.cloud.gateway.rsocket.route.Routes   : Error applying predicate for route: 400

java.lang.NullPointerException: null
	at org.springframework.cloud.gateway.rsocket.routing.RoutingTable.find(RoutingTable.java:194) ~[spring-cloud-gateway-rsocket-broker-2.2.0.BUILD-SNAPSHOT.jar:2.2.0.BUILD-SNAPSHOT]
	at org.springframework.cloud.gateway.rsocket.routing.RoutingTable.findRouteIds(RoutingTable.java:154) ~[spring-cloud-gateway-rsocket-broker-2.2.0.BUILD-SNAPSHOT.jar:2.2.0.BUILD-SNAPSHOT]
	at org.springframework.cloud.gateway.rsocket.routing.RoutingTableRoutes$RoutIdPredicate.apply(RoutingTableRoutes.java:108) ~[spring-cloud-gateway-rsocket-broker-2.2.0.BUILD-SNAPSHOT.jar:2.2.0.BUILD-SNAPSHOT]
	at org.springframework.cloud.gateway.rsocket.routing.RoutingTableRoutes$RoutIdPredicate.apply(RoutingTableRoutes.java:92) ~[spring-cloud-gateway-rsocket-broker-2.2.0.BUILD-SNAPSHOT.jar:2.2.0.BUILD-SNAPSHOT]
	at org.springframework.cloud.gateway.rsocket.route.Routes.lambda$null$0(Routes.java:45) ~[spring-cloud-gateway-rsocket-broker-2.2.0.BUILD-SNAPSHOT.jar:2.2.0.BUILD-SNAPSHOT]
	at reactor.core.publisher.MonoFilterWhen$MonoFilterWhenMain.onNext(MonoFilterWhen.java:116) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.Operators$ScalarSubscription.request(Operators.java:2148) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.MonoFilterWhen$MonoFilterWhenMain.onSubscribe(MonoFilterWhen.java:103) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.MonoJust.subscribe(MonoJust.java:54) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.Mono.subscribe(Mono.java:4087) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxConcatMap$ConcatMapImmediate.drain(FluxConcatMap.java:441) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxConcatMap$ConcatMapImmediate.onSubscribe(FluxConcatMap.java:211) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxIterable.subscribe(FluxIterable.java:139) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxIterable.subscribe(FluxIterable.java:63) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.InternalMonoOperator.subscribe(InternalMonoOperator.java:55) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:52) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at io.rsocket.RSocketResponder.handleRequestResponse(RSocketResponder.java:387) ~[rsocket-core-1.0.0-RC5.jar:na]
	at io.rsocket.RSocketResponder.handleFrame(RSocketResponder.java:299) ~[rsocket-core-1.0.0-RC5.jar:na]
	at reactor.core.publisher.LambdaSubscriber.onNext(LambdaSubscriber.java:160) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:192) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.MonoFlatMapMany$FlatMapManyInner.onNext(MonoFlatMapMany.java:242) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxGroupBy$UnicastGroupedFlux.drainRegular(FluxGroupBy.java:554) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxGroupBy$UnicastGroupedFlux.drain(FluxGroupBy.java:630) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxGroupBy$UnicastGroupedFlux.subscribe(FluxGroupBy.java:696) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.Flux.subscribe(Flux.java:8134) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.MonoFlatMapMany$FlatMapManyMain.onNext(MonoFlatMapMany.java:188) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1592) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.MonoProcessor.onNext(MonoProcessor.java:317) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at io.rsocket.internal.ClientServerInputMultiplexer.lambda$new$1(ClientServerInputMultiplexer.java:116) ~[rsocket-core-1.0.0-RC5.jar:na]
	at reactor.core.publisher.LambdaSubscriber.onNext(LambdaSubscriber.java:160) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxGroupBy$GroupByMain.drainLoop(FluxGroupBy.java:380) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxGroupBy$GroupByMain.drain(FluxGroupBy.java:316) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxGroupBy$GroupByMain.onNext(FluxGroupBy.java:201) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:192) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxMap$MapSubscriber.onNext(FluxMap.java:114) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxMap$MapSubscriber.onNext(FluxMap.java:114) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.netty.channel.FluxReceive.drainReceiver(FluxReceive.java:206) ~[reactor-netty-0.9.0.RELEASE.jar:0.9.0.RELEASE]
	at reactor.netty.channel.FluxReceive.onInboundNext(FluxReceive.java:329) ~[reactor-netty-0.9.0.RELEASE.jar:0.9.0.RELEASE]
	at reactor.netty.channel.ChannelOperations.onInboundNext(ChannelOperations.java:348) ~[reactor-netty-0.9.0.RELEASE.jar:0.9.0.RELEASE]
	at reactor.netty.channel.ChannelOperationsHandler.channelRead(ChannelOperationsHandler.java:91) ~[reactor-netty-0.9.0.RELEASE.jar:0.9.0.RELEASE]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:328) ~[netty-codec-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:302) ~[netty-codec-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044) ~[netty-common-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[netty-common-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[netty-common-4.1.42.Final.jar:4.1.42.Final]
	at java.base/java.lang.Thread.run(Thread.java:834) ~[na:na]

2019-10-21 17:39:12.715 ERROR 20703 --- [ctor-http-nio-3] o.s.cloud.gateway.rsocket.route.Routes   : Error applying predicate for route: 500

java.lang.NullPointerException: null
	at org.springframework.cloud.gateway.rsocket.routing.RoutingTable.find(RoutingTable.java:194) ~[spring-cloud-gateway-rsocket-broker-2.2.0.BUILD-SNAPSHOT.jar:2.2.0.BUILD-SNAPSHOT]
	at org.springframework.cloud.gateway.rsocket.routing.RoutingTable.findRouteIds(RoutingTable.java:154) ~[spring-cloud-gateway-rsocket-broker-2.2.0.BUILD-SNAPSHOT.jar:2.2.0.BUILD-SNAPSHOT]
	at org.springframework.cloud.gateway.rsocket.routing.RoutingTableRoutes$RoutIdPredicate.apply(RoutingTableRoutes.java:108) ~[spring-cloud-gateway-rsocket-broker-2.2.0.BUILD-SNAPSHOT.jar:2.2.0.BUILD-SNAPSHOT]
	at org.springframework.cloud.gateway.rsocket.routing.RoutingTableRoutes$RoutIdPredicate.apply(RoutingTableRoutes.java:92) ~[spring-cloud-gateway-rsocket-broker-2.2.0.BUILD-SNAPSHOT.jar:2.2.0.BUILD-SNAPSHOT]
	at org.springframework.cloud.gateway.rsocket.route.Routes.lambda$null$0(Routes.java:45) ~[spring-cloud-gateway-rsocket-broker-2.2.0.BUILD-SNAPSHOT.jar:2.2.0.BUILD-SNAPSHOT]
	at reactor.core.publisher.MonoFilterWhen$MonoFilterWhenMain.onNext(MonoFilterWhen.java:116) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.Operators$ScalarSubscription.request(Operators.java:2148) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.MonoFilterWhen$MonoFilterWhenMain.onSubscribe(MonoFilterWhen.java:103) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.MonoJust.subscribe(MonoJust.java:54) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.Mono.subscribe(Mono.java:4087) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxConcatMap$ConcatMapImmediate.drain(FluxConcatMap.java:441) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxConcatMap$ConcatMapImmediate.onSubscribe(FluxConcatMap.java:211) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxIterable.subscribe(FluxIterable.java:139) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxIterable.subscribe(FluxIterable.java:63) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.InternalMonoOperator.subscribe(InternalMonoOperator.java:55) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:52) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at io.rsocket.RSocketResponder.handleRequestResponse(RSocketResponder.java:387) ~[rsocket-core-1.0.0-RC5.jar:na]
	at io.rsocket.RSocketResponder.handleFrame(RSocketResponder.java:299) ~[rsocket-core-1.0.0-RC5.jar:na]
	at reactor.core.publisher.LambdaSubscriber.onNext(LambdaSubscriber.java:160) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:192) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.MonoFlatMapMany$FlatMapManyInner.onNext(MonoFlatMapMany.java:242) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxGroupBy$UnicastGroupedFlux.drainRegular(FluxGroupBy.java:554) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxGroupBy$UnicastGroupedFlux.drain(FluxGroupBy.java:630) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxGroupBy$UnicastGroupedFlux.subscribe(FluxGroupBy.java:696) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.Flux.subscribe(Flux.java:8134) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.MonoFlatMapMany$FlatMapManyMain.onNext(MonoFlatMapMany.java:188) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1592) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.MonoProcessor.onNext(MonoProcessor.java:317) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at io.rsocket.internal.ClientServerInputMultiplexer.lambda$new$1(ClientServerInputMultiplexer.java:116) ~[rsocket-core-1.0.0-RC5.jar:na]
	at reactor.core.publisher.LambdaSubscriber.onNext(LambdaSubscriber.java:160) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxGroupBy$GroupByMain.drainLoop(FluxGroupBy.java:380) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxGroupBy$GroupByMain.drain(FluxGroupBy.java:316) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxGroupBy$GroupByMain.onNext(FluxGroupBy.java:201) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxPeek$PeekSubscriber.onNext(FluxPeek.java:192) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxMap$MapSubscriber.onNext(FluxMap.java:114) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.core.publisher.FluxMap$MapSubscriber.onNext(FluxMap.java:114) ~[reactor-core-3.3.0.RELEASE.jar:3.3.0.RELEASE]
	at reactor.netty.channel.FluxReceive.drainReceiver(FluxReceive.java:206) ~[reactor-netty-0.9.0.RELEASE.jar:0.9.0.RELEASE]
	at reactor.netty.channel.FluxReceive.onInboundNext(FluxReceive.java:329) ~[reactor-netty-0.9.0.RELEASE.jar:0.9.0.RELEASE]
	at reactor.netty.channel.ChannelOperations.onInboundNext(ChannelOperations.java:348) ~[reactor-netty-0.9.0.RELEASE.jar:0.9.0.RELEASE]
	at reactor.netty.channel.ChannelOperationsHandler.channelRead(ChannelOperationsHandler.java:91) ~[reactor-netty-0.9.0.RELEASE.jar:0.9.0.RELEASE]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:328) ~[netty-codec-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:302) ~[netty-codec-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514) ~[netty-transport-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044) ~[netty-common-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[netty-common-4.1.42.Final.jar:4.1.42.Final]
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[netty-common-4.1.42.Final.jar:4.1.42.Final]
	at java.base/java.lang.Thread.run(Thread.java:834) ~[na:na]

To reproduce, proceed as follows:

  1. start service-gateway
  2. start reservation-service
  3. start reservation-service-client
  4. send POST request to http://localhost:6666/reservation/create/Michael

Composite metatdata with JS client not working properly

I am using
Spring Boot: 2.2.3.RELEASE

Rsocket springboot server throws an exception for routing metadata which is part of composite metadata

java.lang.IndexOutOfBoundsException: readerIndex(1) + length(105) exceeds writerIndex(23): UnpooledSlicedByteBuf(ridx: 1, widx: 23, cap: 23/23, unwrapped: PooledUnsafeDirectByteBuf(ridx: 0, widx: 231, cap: 231))
	at io.netty.buffer.AbstractByteBuf.checkReadableBytes0(AbstractByteBuf.java:1495)
	Suppressed: reactor.core.publisher.FluxOnAssembly$OnAssemblyException: 
Assembly trace from producer [reactor.core.publisher.MonoError] :
	reactor.core.publisher.Mono.error(Mono.java:281)
	io.rsocket.RSocketResponder.requestResponse(RSocketResponder.java:199)
Error has been observed at the following site(s):
	|_ Mono.error ⇢ at io.rsocket.RSocketResponder.requestResponse(RSocketResponder.java:199)
Stack trace:
		at io.netty.buffer.AbstractByteBuf.checkReadableBytes0(AbstractByteBuf.java:1495)
		at io.netty.buffer.AbstractByteBuf.checkReadableBytes(AbstractByteBuf.java:1478)
		at io.netty.buffer.AbstractByteBuf.readSlice(AbstractByteBuf.java:894)
		at io.rsocket.metadata.TaggingMetadata$1.next(TaggingMetadata.java:47)
		at io.rsocket.metadata.TaggingMetadata$1.next(TaggingMetadata.java:37)
		at org.springframework.messaging.rsocket.DefaultMetadataExtractor.extractEntry(DefaultMetadataExtractor.java:136)
		at org.springframework.messaging.rsocket.DefaultMetadataExtractor.extract(DefaultMetadataExtractor.java:115)
		at org.springframework.messaging.rsocket.annotation.support.MessagingRSocket.createHeaders(MessagingRSocket.java:195)
		at org.springframework.messaging.rsocket.annotation.support.MessagingRSocket.handleAndReply(MessagingRSocket.java:167)
		at org.springframework.messaging.rsocket.annotation.support.MessagingRSocket.requestResponse(MessagingRSocket.java:122)
		at io.rsocket.RSocketResponder.requestResponse(RSocketResponder.java:193)
		at io.rsocket.RSocketResponder.handleFrame(RSocketResponder.java:299)

with js client with composite metadata

     this.socket
         .requestResponse({
           data:  Buffer.from(JSON.stringify(scannerReq)),
           metadata: encodeAndAddWellKnownMetadata(
                           encodeAndAddCustomMetadata(
                             Buffer.alloc(0),
                             TEXT_PLAIN.string,
                             Buffer.from('Hello World')
                          ),
                          
                           MESSAGE_RSOCKET_ROUTING,
                          Buffer.from('irl.user.location.user1')
                     )
         })

i have incorporated this changes as well.

Thanks.

Split Data Cancel

The data transmission process is similar to the following
A ------ B ----- C
--> 7(1025)
--> 2(1025)
2(1024) <--
--> 2(CANCEL)
7(1024) <--
2(11) <--

Actual log data

Frame => Stream ID: 7 Type: REQUEST_RESPONSE Flags: 0b100000000 Length: 1025
Metadata:
+-------------------------------------------------+
| 0 1 2 3 4 5 6 7 8 9 a b c d e f |
+--------+-------------------------------------------------+----------------+
|00000000| fe 00 00 04 03 63 6d 64 1e 6d 65 73 73 61 67 65 |.....cmd.message|
|00000010| 2f 78 2e 72 73 6f 63 6b 65 74 2e 66 6f 72 77 61 |/x.rsocket.forwa|
|00000020| 72 64 69 6e 67 2e 76 30 00 00 15 00 00 00 00 00 |rding.v0........|
|00000030| 00 00 00 00 00 00 00 00 00 00 03 81 03 31 2d 31 |.............1-1|
+--------+-------------------------------------------------+----------------+
Data:
+-------------------------------------------------+
| 0 1 2 3 4 5 6 7 8 9 a b c d e f |
+--------+-------------------------------------------------+----------------+
|00000000| 65 63 68 6f 20 68 65 6c 6c 6f 31 31 31 31 31 31 |echo hello111111|
|00000010| 31 31 31 31 31 78 31 31 31 77 77 31 64 64 64 31 |11111x111ww1ddd1|
|00000020| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000030| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000040| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000050| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000060| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000070| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000080| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 77 |111111111111111w|
|00000090| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|000000a0| 77 77 77 77 77 77 77 71 71 71 71 71 71 71 71 71 |wwwwwwwqqqqqqqqq|
|000000b0| 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 |qqqqqqqqqqqqqqqq|
|000000c0| 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 |qqqqqqqqqqqqqqqq|
|000000d0| 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 |qqqqqqqqqqqqqqqq|
|000000e0| 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 |qqqqqqqqqqqqqqqq|
|000000f0| 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 |qqqqqqqqqqqqqqqq|
|00000100| 71 71 71 71 71 71 71 71 71 71 74 74 74 74 74 74 |qqqqqqqqqqtttttt|
|00000110| 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 |tttttttttttttttt|
|00000120| 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 |tttttttttttttttt|
|00000130| 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 |tttttttttttttttt|
|00000140| 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 |tttttttttttttttt|
|00000150| 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 |tttttttttttttttt|
|00000160| 74 74 74 74 74 74 74 74 74 75 75 75 75 75 75 75 |tttttttttuuuuuuu|
|00000170| 75 75 75 75 75 75 75 75 75 75 75 75 75 75 75 75 |uuuuuuuuuuuuuuuu|
|00000180| 75 75 75 75 75 75 75 75 75 75 75 75 75 75 75 75 |uuuuuuuuuuuuuuuu|
|00000190| 75 75 75 75 75 75 75 75 75 75 75 75 75 75 75 75 |uuuuuuuuuuuuuuuu|
|000001a0| 75 75 75 75 75 75 69 69 69 69 69 69 69 69 69 69 |uuuuuuiiiiiiiiii|
|000001b0| 69 69 69 69 69 69 69 69 69 69 69 69 69 69 69 69 |iiiiiiiiiiiiiiii|
|000001c0| 69 69 69 69 69 69 69 69 69 69 69 69 69 69 69 69 |iiiiiiiiiiiiiiii|
|000001d0| 69 69 69 69 69 69 69 69 69 69 69 69 69 69 69 77 |iiiiiiiiiiiiiiiw|
|000001e0| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|000001f0| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000200| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000210| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000220| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000230| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000240| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000250| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000260| 77 77 77 77 77 31 31 31 61 61 61 61 61 61 61 61 |wwwww111aaaaaaaa|
|00000270| 61 61 61 61 61 61 61 61 61 61 61 61 61 61 61 61 |aaaaaaaaaaaaaaaa|
|00000280| 61 61 61 61 61 61 61 61 61 61 61 61 61 61 61 61 |aaaaaaaaaaaaaaaa|
|00000290| 61 61 61 61 61 61 61 61 61 61 61 61 61 61 61 61 |aaaaaaaaaaaaaaaa|
|000002a0| 61 65 65 65 65 65 65 65 65 65 65 65 65 65 65 65 |aeeeeeeeeeeeeeee|
|000002b0| 65 65 65 65 65 65 65 65 65 65 65 65 65 65 65 65 |eeeeeeeeeeeeeeee|
|000002c0| 65 65 65 65 65 65 65 65 65 65 65 65 65 65 65 65 |eeeeeeeeeeeeeeee|
|000002d0| 65 65 65 65 65 65 65 65 65 65 65 65 65 65 31 31 |eeeeeeeeeeeeee11|
|000002e0| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|000002f0| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000300| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000310| 31 31 31 31 31 31 31 31 31 31 31 31 31 64 61 61 |1111111111111daa|
|00000320| 61 61 61 61 61 61 61 61 61 61 73 73 73 73 73 73 |aaaaaaaaaassssss|
|00000330| 73 73 73 73 73 73 73 73 73 73 73 73 73 73 73 73 |ssssssssssssssss|
|00000340| 73 73 73 73 73 73 73 73 73 73 73 73 73 73 64 64 |ssssssssssssssdd|
|00000350| 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 |dddddddddddddddd|
|00000360| 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 |dddddddddddddddd|
|00000370| 64 64 64 64 64 64 64 64 64 64 31 31 31 31 31 31 |dddddddddd111111|
|00000380| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000390| 31 31 31 31 32 32 32 32 32 32 32 32 32 32 32 32 |1111222222222222|
|000003a0| 32 32 32 32 32 32 32 32 32 32 32 32 32 32 32 32 |2222222222222222|
|000003b0| 32 32 64 31 31 31 31 61 |22d1111a |
+--------+-------------------------------------------------+----------------+
2020-05-29 17:10:31.260 DEBUG 102872 --- [ctor-http-nio-3] o.s.c.g.rsocket.core.GatewayExchange : found routing metadata [Forwarding@31b460e6 originRouteId = 3, tags = map[[io.rsocket.routing.ServiceName, 0x01] -> '1-1']]
2020-05-29 17:10:31.260 DEBUG 102872 --- [ctor-http-nio-3] o.s.c.g.r.routing.RoutingTableRoutes : Found routes: [[RoutingTableRoutes.RegistryRoute@26639206 id = '3', predicate = [RoutIdPredicate 3]], [RoutingTableRoutes.RegistryRoute@35c4697c id = '1234', predicate = [RoutIdPredicate 1234]], [RoutingTableRoutes.RegistryRoute@e2b838e id = '10', predicate = [RoutIdPredicate 10]]]
2020-05-29 17:10:31.261 DEBUG 102872 --- [ctor-http-nio-3] o.s.c.g.rsocket.core.GatewayRSocket : Unable to find destination RSocket for [Forwarding@31b460e6 originRouteId = 3, tags = map[[io.rsocket.routing.ServiceName, 0x01] -> '1-1']]
2020-05-29 17:10:31.261 DEBUG 102872 --- [ctor-http-nio-3] o.s.c.g.r.core.PendingRequestRSocket : creating pending RSocket for [Forwarding@31b460e6 originRouteId = 3, tags = map[[io.rsocket.routing.ServiceName, 0x01] -> '1-1']]
2020-05-29 17:10:31.261 TRACE 102872 --- [ctor-http-nio-3] o.s.c.g.r.c.GatewayRSocket.find route : | onSubscribe([Fuseable] FluxOnAssembly.OnAssemblySubscriber)
2020-05-29 17:10:31.261 TRACE 102872 --- [ctor-http-nio-3] o.s.c.g.r.c.GatewayRSocket.find route : | request(unbounded)
2020-05-29 17:10:31.262 DEBUG 102872 --- [ctor-http-nio-3] o.s.cloud.gateway.rsocket.route.Routes : Route matched: 10
2020-05-29 17:10:31.262 TRACE 102872 --- [ctor-http-nio-3] o.s.c.g.r.c.GatewayRSocket.find route : | onNext([RoutingTableRoutes.RegistryRoute@e2b838e id = '10', predicate = [RoutIdPredicate 10]])
2020-05-29 17:10:31.262 DEBUG 102872 --- [ctor-http-nio-3] o.s.c.g.rsocket.core.GatewayFilterChain : filter chain completed with success
2020-05-29 17:10:31.263 TRACE 102872 --- [ctor-http-nio-3] o.s.c.g.r.c.G.after filter chain : | onSubscribe([Fuseable] FluxOnAssembly.OnAssemblySubscriber)
2020-05-29 17:10:31.263 TRACE 102872 --- [ctor-http-nio-3] o.s.c.g.r.c.GatewayRSocket.find rsocket : | onSubscribe([Fuseable] FluxOnAssembly.OnAssemblySubscriber)
2020-05-29 17:10:31.263 TRACE 102872 --- [ctor-http-nio-3] o.s.c.g.r.c.GatewayRSocket.find rsocket : | request(unbounded)
2020-05-29 17:10:31.263 TRACE 102872 --- [ctor-http-nio-3] o.s.c.g.r.c.G.after filter chain : | request(unbounded)
2020-05-29 17:10:31.263 TRACE 102872 --- [ctor-http-nio-3] o.s.c.g.r.c.G.after filter chain : | onNext(INSTANCE)
2020-05-29 17:10:31.263 DEBUG 102872 --- [ctor-http-nio-3] o.s.c.g.rsocket.core.GatewayRSocket : Found RSocket: org.springframework.cloud.gateway.rsocket.metrics.MicrometerResponderRSocket@31be4d47
2020-05-29 17:10:31.263 TRACE 102872 --- [ctor-http-nio-3] o.s.c.g.r.c.GatewayRSocket.find rsocket : | onNext([org.springframework.cloud.gateway.rsocket.metrics.MicrometerResponderRSocket@31be4d47])
2020-05-29 17:10:31.264 TRACE 102872 --- [ctor-http-nio-3] o.s.c.g.r.c.GatewayRSocket.find rsocket : | onComplete()
2020-05-29 17:10:31.265 DEBUG 102872 --- [ctor-http-nio-4] io.rsocket.FrameLogger : sending ->
Frame => Stream ID: 2 Type: REQUEST_RESPONSE Flags: 0b100000000 Length: 1025
Metadata:
+-------------------------------------------------+
| 0 1 2 3 4 5 6 7 8 9 a b c d e f |
+--------+-------------------------------------------------+----------------+
|00000000| fe 00 00 04 03 63 6d 64 1e 6d 65 73 73 61 67 65 |.....cmd.message|
|00000010| 2f 78 2e 72 73 6f 63 6b 65 74 2e 66 6f 72 77 61 |/x.rsocket.forwa|
|00000020| 72 64 69 6e 67 2e 76 30 00 00 15 00 00 00 00 00 |rding.v0........|
|00000030| 00 00 00 00 00 00 00 00 00 00 03 81 03 31 2d 31 |.............1-1|
+--------+-------------------------------------------------+----------------+
Data:
+-------------------------------------------------+
| 0 1 2 3 4 5 6 7 8 9 a b c d e f |
+--------+-------------------------------------------------+----------------+
|00000000| 65 63 68 6f 20 68 65 6c 6c 6f 31 31 31 31 31 31 |echo hello111111|
|00000010| 31 31 31 31 31 78 31 31 31 77 77 31 64 64 64 31 |11111x111ww1ddd1|
|00000020| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000030| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000040| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000050| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000060| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000070| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000080| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 77 |111111111111111w|
|00000090| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|000000a0| 77 77 77 77 77 77 77 71 71 71 71 71 71 71 71 71 |wwwwwwwqqqqqqqqq|
|000000b0| 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 |qqqqqqqqqqqqqqqq|
|000000c0| 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 |qqqqqqqqqqqqqqqq|
|000000d0| 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 |qqqqqqqqqqqqqqqq|
|000000e0| 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 |qqqqqqqqqqqqqqqq|
|000000f0| 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 |qqqqqqqqqqqqqqqq|
|00000100| 71 71 71 71 71 71 71 71 71 71 74 74 74 74 74 74 |qqqqqqqqqqtttttt|
|00000110| 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 |tttttttttttttttt|
|00000120| 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 |tttttttttttttttt|
|00000130| 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 |tttttttttttttttt|
|00000140| 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 |tttttttttttttttt|
|00000150| 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 |tttttttttttttttt|
|00000160| 74 74 74 74 74 74 74 74 74 75 75 75 75 75 75 75 |tttttttttuuuuuuu|
|00000170| 75 75 75 75 75 75 75 75 75 75 75 75 75 75 75 75 |uuuuuuuuuuuuuuuu|
|00000180| 75 75 75 75 75 75 75 75 75 75 75 75 75 75 75 75 |uuuuuuuuuuuuuuuu|
|00000190| 75 75 75 75 75 75 75 75 75 75 75 75 75 75 75 75 |uuuuuuuuuuuuuuuu|
|000001a0| 75 75 75 75 75 75 69 69 69 69 69 69 69 69 69 69 |uuuuuuiiiiiiiiii|
|000001b0| 69 69 69 69 69 69 69 69 69 69 69 69 69 69 69 69 |iiiiiiiiiiiiiiii|
|000001c0| 69 69 69 69 69 69 69 69 69 69 69 69 69 69 69 69 |iiiiiiiiiiiiiiii|
|000001d0| 69 69 69 69 69 69 69 69 69 69 69 69 69 69 69 77 |iiiiiiiiiiiiiiiw|
|000001e0| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|000001f0| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000200| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000210| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000220| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000230| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000240| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000250| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000260| 77 77 77 77 77 31 31 31 61 61 61 61 61 61 61 61 |wwwww111aaaaaaaa|
|00000270| 61 61 61 61 61 61 61 61 61 61 61 61 61 61 61 61 |aaaaaaaaaaaaaaaa|
|00000280| 61 61 61 61 61 61 61 61 61 61 61 61 61 61 61 61 |aaaaaaaaaaaaaaaa|
|00000290| 61 61 61 61 61 61 61 61 61 61 61 61 61 61 61 61 |aaaaaaaaaaaaaaaa|
|000002a0| 61 65 65 65 65 65 65 65 65 65 65 65 65 65 65 65 |aeeeeeeeeeeeeeee|
|000002b0| 65 65 65 65 65 65 65 65 65 65 65 65 65 65 65 65 |eeeeeeeeeeeeeeee|
|000002c0| 65 65 65 65 65 65 65 65 65 65 65 65 65 65 65 65 |eeeeeeeeeeeeeeee|
|000002d0| 65 65 65 65 65 65 65 65 65 65 65 65 65 65 31 31 |eeeeeeeeeeeeee11|
|000002e0| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|000002f0| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000300| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000310| 31 31 31 31 31 31 31 31 31 31 31 31 31 64 61 61 |1111111111111daa|
|00000320| 61 61 61 61 61 61 61 61 61 61 73 73 73 73 73 73 |aaaaaaaaaassssss|
|00000330| 73 73 73 73 73 73 73 73 73 73 73 73 73 73 73 73 |ssssssssssssssss|
|00000340| 73 73 73 73 73 73 73 73 73 73 73 73 73 73 64 64 |ssssssssssssssdd|
|00000350| 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 |dddddddddddddddd|
|00000360| 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 |dddddddddddddddd|
|00000370| 64 64 64 64 64 64 64 64 64 64 31 31 31 31 31 31 |dddddddddd111111|
|00000380| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000390| 31 31 31 31 32 32 32 32 32 32 32 32 32 32 32 32 |1111222222222222|
|000003a0| 32 32 32 32 32 32 32 32 32 32 32 32 32 32 32 32 |2222222222222222|
|000003b0| 32 32 64 31 31 31 31 61 |22d1111a |
+--------+-------------------------------------------------+----------------+
2020-05-29 17:10:31.264 TRACE 102872 --- [ctor-http-nio-3] o.s.c.g.r.c.G.after filter chain : | onComplete()
2020-05-29 17:10:31.266 TRACE 102872 --- [ctor-http-nio-3] o.s.c.g.r.c.GatewayRSocket.find route : | onComplete()
2020-05-29 17:10:31.415 DEBUG 102872 --- [ctor-http-nio-4] io.rsocket.FrameLogger : receiving ->
Frame => Stream ID: 2 Type: NEXT_COMPLETE Flags: 0b111100000 Length: 1024
Metadata:
+-------------------------------------------------+
| 0 1 2 3 4 5 6 7 8 9 a b c d e f |
+--------+-------------------------------------------------+----------------+
|00000000| fe 00 00 04 03 63 6d 64 1e 6d 65 73 73 61 67 65 |.....cmd.message|
|00000010| 2f 78 2e 72 73 6f 63 6b 65 74 2e 66 6f 72 77 61 |/x.rsocket.forwa|
|00000020| 72 64 69 6e 67 2e 76 30 00 00 15 00 00 00 00 00 |rding.v0........|
|00000030| 00 00 00 00 00 00 00 00 00 00 03 81 03 31 2d 31 |.............1-1|
+--------+-------------------------------------------------+----------------+
Data:
+-------------------------------------------------+
| 0 1 2 3 4 5 6 7 8 9 a b c d e f |
+--------+-------------------------------------------------+----------------+
|00000000| 62 61 63 6b 65 63 68 6f 20 68 65 6c 6c 6f 31 31 |backecho hello11|
|00000010| 31 31 31 31 31 31 31 31 31 78 31 31 31 77 77 31 |111111111x111ww1|
|00000020| 64 64 64 31 31 31 31 31 31 31 31 31 31 31 31 31 |ddd1111111111111|
|00000030| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000040| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000050| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000060| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000070| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000080| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000090| 31 31 31 77 77 77 77 77 77 77 77 77 77 77 77 77 |111wwwwwwwwwwwww|
|000000a0| 77 77 77 77 77 77 77 77 77 77 77 71 71 71 71 71 |wwwwwwwwwwwqqqqq|
|000000b0| 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 |qqqqqqqqqqqqqqqq|
|000000c0| 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 |qqqqqqqqqqqqqqqq|
|000000d0| 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 |qqqqqqqqqqqqqqqq|
|000000e0| 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 |qqqqqqqqqqqqqqqq|
|000000f0| 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 |qqqqqqqqqqqqqqqq|
|00000100| 71 71 71 71 71 71 71 71 71 71 71 71 71 71 74 74 |qqqqqqqqqqqqqqtt|
|00000110| 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 |tttttttttttttttt|
|00000120| 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 |tttttttttttttttt|
|00000130| 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 |tttttttttttttttt|
|00000140| 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 |tttttttttttttttt|
|00000150| 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 |tttttttttttttttt|
|00000160| 74 74 74 74 74 74 74 74 74 74 74 74 74 75 75 75 |tttttttttttttuuu|
|00000170| 75 75 75 75 75 75 75 75 75 75 75 75 75 75 75 75 |uuuuuuuuuuuuuuuu|
|00000180| 75 75 75 75 75 75 75 75 75 75 75 75 75 75 75 75 |uuuuuuuuuuuuuuuu|
|00000190| 75 75 75 75 75 75 75 75 75 75 75 75 75 75 75 75 |uuuuuuuuuuuuuuuu|
|000001a0| 75 75 75 75 75 75 75 75 75 75 69 69 69 69 69 69 |uuuuuuuuuuiiiiii|
|000001b0| 69 69 69 69 69 69 69 69 69 69 69 69 69 69 69 69 |iiiiiiiiiiiiiiii|
|000001c0| 69 69 69 69 69 69 69 69 69 69 69 69 69 69 69 69 |iiiiiiiiiiiiiiii|
|000001d0| 69 69 69 69 69 69 69 69 69 69 69 69 69 69 69 69 |iiiiiiiiiiiiiiii|
|000001e0| 69 69 69 77 77 77 77 77 77 77 77 77 77 77 77 77 |iiiwwwwwwwwwwwww|
|000001f0| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000200| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000210| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000220| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000230| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000240| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000250| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000260| 77 77 77 77 77 77 77 77 77 31 31 31 61 61 61 61 |wwwwwwwww111aaaa|
|00000270| 61 61 61 61 61 61 61 61 61 61 61 61 61 61 61 61 |aaaaaaaaaaaaaaaa|
|00000280| 61 61 61 61 61 61 61 61 61 61 61 61 61 61 61 61 |aaaaaaaaaaaaaaaa|
|00000290| 61 61 61 61 61 61 61 61 61 61 61 61 61 61 61 61 |aaaaaaaaaaaaaaaa|
|000002a0| 61 61 61 61 61 65 65 65 65 65 65 65 65 65 65 65 |aaaaaeeeeeeeeeee|
|000002b0| 65 65 65 65 65 65 65 65 65 65 65 65 65 65 65 65 |eeeeeeeeeeeeeeee|
|000002c0| 65 65 65 65 65 65 65 65 65 65 65 65 65 65 65 65 |eeeeeeeeeeeeeeee|
|000002d0| 65 65 65 65 65 65 65 65 65 65 65 65 65 65 65 65 |eeeeeeeeeeeeeeee|
|000002e0| 65 65 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |ee11111111111111|
|000002f0| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000300| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000310| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000320| 31 64 61 61 61 61 61 61 61 61 61 61 61 61 73 73 |1daaaaaaaaaaaass|
|00000330| 73 73 73 73 73 73 73 73 73 73 73 73 73 73 73 73 |ssssssssssssssss|
|00000340| 73 73 73 73 73 73 73 73 73 73 73 73 73 73 73 73 |ssssssssssssssss|
|00000350| 73 73 64 64 64 64 64 64 64 64 64 64 64 64 64 64 |ssdddddddddddddd|
|00000360| 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 |dddddddddddddddd|
|00000370| 64 64 64 64 64 64 64 64 64 64 64 64 64 64 31 31 |dddddddddddddd11|
|00000380| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000390| 31 31 31 31 31 31 31 31 32 32 32 32 32 32 32 32 |1111111122222222|
|000003a0| 32 32 32 32 32 32 32 32 32 32 32 32 32 32 32 32 |2222222222222222|
|000003b0| 32 32 32 32 32 32 64 |222222d |
+--------+-------------------------------------------------+----------------+
2020-05-29 17:10:31.417 DEBUG 102872 --- [ctor-http-nio-4] io.rsocket.FrameLogger : sending ->
Frame => Stream ID: 2 Type: CANCEL Flags: 0b0 Length: 6
Data:

2020-05-29 17:10:31.417 DEBUG 102872 --- [ctor-http-nio-3] io.rsocket.FrameLogger : sending ->
Frame => Stream ID: 7 Type: NEXT_COMPLETE Flags: 0b101100000 Length: 1024
Metadata:
+-------------------------------------------------+
| 0 1 2 3 4 5 6 7 8 9 a b c d e f |
+--------+-------------------------------------------------+----------------+
|00000000| fe 00 00 04 03 63 6d 64 1e 6d 65 73 73 61 67 65 |.....cmd.message|
|00000010| 2f 78 2e 72 73 6f 63 6b 65 74 2e 66 6f 72 77 61 |/x.rsocket.forwa|
|00000020| 72 64 69 6e 67 2e 76 30 00 00 15 00 00 00 00 00 |rding.v0........|
|00000030| 00 00 00 00 00 00 00 00 00 00 03 81 03 31 2d 31 |.............1-1|
+--------+-------------------------------------------------+----------------+
Data:
+-------------------------------------------------+
| 0 1 2 3 4 5 6 7 8 9 a b c d e f |
+--------+-------------------------------------------------+----------------+
|00000000| 62 61 63 6b 65 63 68 6f 20 68 65 6c 6c 6f 31 31 |backecho hello11|
|00000010| 31 31 31 31 31 31 31 31 31 78 31 31 31 77 77 31 |111111111x111ww1|
|00000020| 64 64 64 31 31 31 31 31 31 31 31 31 31 31 31 31 |ddd1111111111111|
|00000030| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000040| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000050| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000060| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000070| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000080| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000090| 31 31 31 77 77 77 77 77 77 77 77 77 77 77 77 77 |111wwwwwwwwwwwww|
|000000a0| 77 77 77 77 77 77 77 77 77 77 77 71 71 71 71 71 |wwwwwwwwwwwqqqqq|
|000000b0| 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 |qqqqqqqqqqqqqqqq|
|000000c0| 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 |qqqqqqqqqqqqqqqq|
|000000d0| 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 |qqqqqqqqqqqqqqqq|
|000000e0| 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 |qqqqqqqqqqqqqqqq|
|000000f0| 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 71 |qqqqqqqqqqqqqqqq|
|00000100| 71 71 71 71 71 71 71 71 71 71 71 71 71 71 74 74 |qqqqqqqqqqqqqqtt|
|00000110| 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 |tttttttttttttttt|
|00000120| 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 |tttttttttttttttt|
|00000130| 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 |tttttttttttttttt|
|00000140| 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 |tttttttttttttttt|
|00000150| 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 74 |tttttttttttttttt|
|00000160| 74 74 74 74 74 74 74 74 74 74 74 74 74 75 75 75 |tttttttttttttuuu|
|00000170| 75 75 75 75 75 75 75 75 75 75 75 75 75 75 75 75 |uuuuuuuuuuuuuuuu|
|00000180| 75 75 75 75 75 75 75 75 75 75 75 75 75 75 75 75 |uuuuuuuuuuuuuuuu|
|00000190| 75 75 75 75 75 75 75 75 75 75 75 75 75 75 75 75 |uuuuuuuuuuuuuuuu|
|000001a0| 75 75 75 75 75 75 75 75 75 75 69 69 69 69 69 69 |uuuuuuuuuuiiiiii|
|000001b0| 69 69 69 69 69 69 69 69 69 69 69 69 69 69 69 69 |iiiiiiiiiiiiiiii|
|000001c0| 69 69 69 69 69 69 69 69 69 69 69 69 69 69 69 69 |iiiiiiiiiiiiiiii|
|000001d0| 69 69 69 69 69 69 69 69 69 69 69 69 69 69 69 69 |iiiiiiiiiiiiiiii|
|000001e0| 69 69 69 77 77 77 77 77 77 77 77 77 77 77 77 77 |iiiwwwwwwwwwwwww|
|000001f0| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000200| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000210| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000220| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000230| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000240| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000250| 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 77 |wwwwwwwwwwwwwwww|
|00000260| 77 77 77 77 77 77 77 77 77 31 31 31 61 61 61 61 |wwwwwwwww111aaaa|
|00000270| 61 61 61 61 61 61 61 61 61 61 61 61 61 61 61 61 |aaaaaaaaaaaaaaaa|
|00000280| 61 61 61 61 61 61 61 61 61 61 61 61 61 61 61 61 |aaaaaaaaaaaaaaaa|
|00000290| 61 61 61 61 61 61 61 61 61 61 61 61 61 61 61 61 |aaaaaaaaaaaaaaaa|
|000002a0| 61 61 61 61 61 65 65 65 65 65 65 65 65 65 65 65 |aaaaaeeeeeeeeeee|
|000002b0| 65 65 65 65 65 65 65 65 65 65 65 65 65 65 65 65 |eeeeeeeeeeeeeeee|
|000002c0| 65 65 65 65 65 65 65 65 65 65 65 65 65 65 65 65 |eeeeeeeeeeeeeeee|
|000002d0| 65 65 65 65 65 65 65 65 65 65 65 65 65 65 65 65 |eeeeeeeeeeeeeeee|
|000002e0| 65 65 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |ee11111111111111|
|000002f0| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000300| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000310| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000320| 31 64 61 61 61 61 61 61 61 61 61 61 61 61 73 73 |1daaaaaaaaaaaass|
|00000330| 73 73 73 73 73 73 73 73 73 73 73 73 73 73 73 73 |ssssssssssssssss|
|00000340| 73 73 73 73 73 73 73 73 73 73 73 73 73 73 73 73 |ssssssssssssssss|
|00000350| 73 73 64 64 64 64 64 64 64 64 64 64 64 64 64 64 |ssdddddddddddddd|
|00000360| 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 64 |dddddddddddddddd|
|00000370| 64 64 64 64 64 64 64 64 64 64 64 64 64 64 31 31 |dddddddddddddd11|
|00000380| 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 31 |1111111111111111|
|00000390| 31 31 31 31 31 31 31 31 32 32 32 32 32 32 32 32 |1111111122222222|
|000003a0| 32 32 32 32 32 32 32 32 32 32 32 32 32 32 32 32 |2222222222222222|
|000003b0| 32 32 32 32 32 32 64 |222222d |
+--------+-------------------------------------------------+----------------+
2020-05-29 17:10:31.418 DEBUG 102872 --- [ctor-http-nio-4] io.rsocket.FrameLogger : receiving ->
Frame => Stream ID: 2 Type: NEXT Flags: 0b100000 Length: 11
Data:
+-------------------------------------------------+
| 0 1 2 3 4 5 6 7 8 9 a b c d e f |
+--------+-------------------------------------------------+----------------+
|00000000| 31 31 31 31 61 |1111a |
+--------+-------------------------------------------------+----------------+

io.rsocket.exceptions.RejectedSetupException when Spring Cloud Bus is on Classpath

@FWinkler79 said:
I am using ...
Spring Boot: 2.2.0.RELEASE
Spring Cloud: Hoxton.BUILD-SNAPSHOT
Sample project: here

The service-gateway uses Spring Cloud Gateway with RSocket support and reservation-service-client is an application that acts as a client to the (RSocket Broker) Gateway. In my production setup, ?reservation-service-client gets its configurations from a Spring Cloud config-server and config updates via Rabbit MQ and Spring Cloud Bus (which is why I need Spring Cloud Bus on the classpath).

Problem is: as soon as Spring Cloud Bus is on the classpath, I receive an Exception at startup of reservation-service-client which looks as follows:

2019-10-21 13:40:09.145  INFO 11104 --- [           main] c.e.r.s.client.ReservationServiceClient  : Started ReservationServiceClient in 2.916 seconds (JVM running for 3.606)
io.rsocket.exceptions.RejectedSetupException: Route Id already registered: 500
	at io.rsocket.exceptions.Exceptions.from(Exceptions.java:61)
	at io.rsocket.RSocketRequester.handleStreamZero(RSocketRequester.java:528)
	at io.rsocket.RSocketRequester.handleIncomingFrames(RSocketRequester.java:514)
	at reactor.core.publisher.LambdaSubscriber.onNext(LambdaSubscriber.java:160)
	at reactor.core.publisher.MonoFlatMapMany$FlatMapManyInner.onNext(MonoFlatMapMany.java:242)
	at reactor.core.publisher.FluxGroupBy$UnicastGroupedFlux.drainRegular(FluxGroupBy.java:554)
	at reactor.core.publisher.FluxGroupBy$UnicastGroupedFlux.drain(FluxGroupBy.java:630)
	at reactor.core.publisher.FluxGroupBy$UnicastGroupedFlux.subscribe(FluxGroupBy.java:696)
	at reactor.core.publisher.Flux.subscribe(Flux.java:8134)
	at reactor.core.publisher.MonoFlatMapMany$FlatMapManyMain.onNext(MonoFlatMapMany.java:188)
	at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1592)
	at reactor.core.publisher.MonoProcessor.onNext(MonoProcessor.java:317)
	at io.rsocket.internal.ClientServerInputMultiplexer.lambda$new$1(ClientServerInputMultiplexer.java:116)
	at reactor.core.publisher.LambdaSubscriber.onNext(LambdaSubscriber.java:160)
	at reactor.core.publisher.FluxGroupBy$GroupByMain.drainLoop(FluxGroupBy.java:380)
	at reactor.core.publisher.FluxGroupBy$GroupByMain.drain(FluxGroupBy.java:316)
	at reactor.core.publisher.FluxGroupBy$GroupByMain.onNext(FluxGroupBy.java:201)
	at reactor.core.publisher.FluxMap$MapSubscriber.onNext(FluxMap.java:114)
	at reactor.core.publisher.FluxMap$MapSubscriber.onNext(FluxMap.java:114)
	at reactor.netty.channel.FluxReceive.drainReceiver(FluxReceive.java:206)
	at reactor.netty.channel.FluxReceive.onInboundNext(FluxReceive.java:329)
	at reactor.netty.channel.ChannelOperations.onInboundNext(ChannelOperations.java:348)
	at reactor.netty.channel.ChannelOperationsHandler.channelRead(ChannelOperationsHandler.java:91)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
	at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:328)
	at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:302)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931)
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700)
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552)
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514)
	at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	at java.base/java.lang.Thread.run(Thread.java:834)

This only occurs, if the following dependency is declared:

<dependency>
  <groupId>org.springframework.cloud</groupId>
  <artifactId>spring-cloud-bus</artifactId>
</dependency>

I am not sure, this exception is actually a problem but it's certainly not nice.

To reproduce:

  1. start service-gateway
  2. start reservation-service-client
  3. To see the error disappear, comment out spring-cloud-bus dependency in reservation-service-client/pom.xml and start again,

Meta issue

A place to make a list of things that need to be done before a full GA release.

  • Note that as of Hoxton.RELEASE these modules will be a tech preview Move to incubator until the RSocket routing/forwarding protocol extension and corresponding rsocket-java implementation is done.
  • Custom client RSocketRequester that auto adds metadata ae9a6d3e9f4cdbd4cb7897dd11112a1e5a025575
  • Auto client subscribe to auto-configured RSocketRequester e8fd2ca5f1ae6815581e275cc5fab440768f10d7
  • Migrate to reactive Spring Cloud Loadbalancer
  • Deregistrations on disconnect.
  • client and broker retry on disconnect (try different node after failure)
  • ByteBuf leak stoppage
  • Dynamic cluster join (connect to seed node, then let it tell you about the rest)
  • Auto connect to new cluster nodes
  • Broker documentation
  • Client documentation
  • Config Props documentation
  • More component unit tests (including each rsocket interacion type)
  • More integration tests (including each rsocket interacion type)
  • Migrate to extension impl in rsocket-java
  • Timeout option on PendingRSocket
  • Comments with quotes from routing/forwarding extension

Typical/expected numbers of routes in a routing table

I'm interested in the routing table implementation - specifically to know how many routes would be typical in a spring cloud gateway deployment? If it's less than 100k, RoaringBitmap might not be the best data structure. If it's more likely to number in the tens, exactly the same idea can be implemented using a long per tag, saving a lot of space and cycles to match tags to routes. The answer is probably that it varies but usually somewhere in between the two extremes, so an adaptive mechanism would be ideal.

PendingRSocket created accidentally

I am using ...
Spring Boot: 2.2.0-BUILD-SNAPSHOT
Spring Cloud: Hoxton.BUILD-SNAPSHOT
Spring Cloud RSocket: 0.2.0.BUILD-SNAPSHOT
Sample project: here

Step to reproduce:

  • start gateway1
  • start gateway2 with broker set to gateway1
  • a pendingRSocket is created but not used.

It looks like GatewayRSocket::findRSocketOrCreatePending is calling createPending() before findRoute() complete, I think this do.

Retry Issue with RSocket Broker

@FWinkler79 said in spring-cloud/spring-cloud-gateway#1355 :
I just saw issue #6, so I apologize if this is simply not yet implemented.

I saw @spencergibb's nice presentation on SCG and RSocket and took the liberty to fork his sample and adjust it a little for my tests.

I added two failure-scenarios to the sample, one of which I would have expected another outcome of. I modified PingService's request-channel handling to retry in case of errors.

The scenario is as follows:

  1. run two gateway instances in cluster mode
  2. run ping and see maximum back pressure applied from gateway
  3. run pong and see how pings and pongs start flowing
  4. stop pong, simulating the pong instance going down.
  5. start pong again.

What I was hoping to see, is that ping receives an error, retries and again is confronted with maximum back pressure from the gateway.

What I saw instead is, that ping retries, silently keeps sending pings to the gateway cluster which seems to buffer the pings, and then forwards all of them to pong once that is up again.

I am not sure this is intended, and I am not 100% sure if maybe I have a bug in my own coding, but I think, it would be better, if the gateway sent maximum back pressure also in the case a remote service goes down. Maybe that goes into the direction of Deregistrations on disconnect in #1319?

If you want to try this out yourself, here is my adjusted fork:
https://github.com/FWinkler79/spring-cloud-gateway-rsocket-sample#failure-resiliency-2

It would be great to have this feature, as it would make it so much easier for application developers to create resilient Cloud applications - simply by properly handling back pressure (which they generally should have to anyway).

Also, having the gateway buffer the incoming requests from clients and replay them to servers once they are up again, might cause the servers to immediately go down again.

If my understanding is incorrect, please let me know.

Document forwarding metadata with dots in keys

I am using ...
Spring Boot: 2.2.0.RELEASE
Spring Cloud: Hoxton.BUILD-SNAPSHOT
Sample project: here
"Fixed" project: here

I tried to follow the presentation and declarative routing information as shown here at the Spring One conference.

There is an issue with declarative routing / forwarding information specified in application.yml of an RSocket client, if the route contains dots (.).

Above you can find a sample that consists of the following components:

  1. reservation-service - an RSocket client exposing an endpoint by the route create.reservation that will be called by reservation-service-client via the gateway.
  2. reservation-service-client - an RSocket client exposing a WebFlux API to receive POST requests that get translated into an RSocket request to reservation-service.
  3. service-gateway - the RSocket broker-enabled SCG

With reservation-service-client's application.yml specifying the following routing metadata the gateway will fail forwarding the request with a NullPointerException since the client does not send the routing metadata properly:

spring:
  cloud:
    gateway:
      rsocket:
        client:
          forwarding:
            create.reservation:
              service_name: reservation-service
              canary: false

The issue is in the dotted syntax of the route, which in a Yaml file gets interpreted as a hierarchy.
I guess the matching between the client's called route, and the routing information in Yaml therefore fails.

A working sample is also given above, which uses dashes instead of dots.

To reproduce:

  1. start service-gateway
  2. start reservation-service
  3. start reservation-service-client
  4. Send a POST request with empty body to http://localhost:6666/reservation/create/RSocketRules

See also #1 which is related, but note that it additionally uses dynamic parts in the route.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.