Git Product home page Git Product logo

cross-cluster-replication's People

Contributors

amazon-auto avatar krishna-ggk avatar shams-yang avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar

cross-cluster-replication's Issues

dead link to plugin ZIP in Dockerfile

the Dockerfile contains a dead link to a ZIP file for this plugin:

RUN /usr/share/elasticsearch/bin/elasticsearch-plugin install -v https://github.com/opendistro-for-elasticsearch/cross-cluster-replication/releases/download/v1.13.0.0-experimental/opendistro-cross-cluster-replication-1.13.0.0.zip

thus it won't work.

see also: https://discuss.opendistrocommunity.dev/t/unable-to-install-ccr-plugin-or-install-via-example/6429

Upgrading Amazon Elasticsearch 7.x to OpenSearch 1.0 throws TCP error

I am getting Validation error while setting up cross-cluster search across 2 upgraded OpenSearch 1.0 domains. Both domains are in same VPC and Security Groups and also have met all 3 pre-reqs:
FGAC enabled
Node-to-node encryption enabled
Created after 06/2020

Error from CW logs:
[2021-09-29T13:30:22,264][WARN ][o.o.c.NodeConnectionsService] [6d0c08d5974adef60c469f321770d303] failed to connect to {4283ef20b232bf4a5e8b92e3f80ab1d6}{aN5KJrngQhqTaIHfqGPDhw}{ufxk_dVHSx-9y3FN2ALnJQ}{IP}{IP}{imr}{dp_version=20210501, box_type=dedicated-master, distributed_snapshot_deletion_enabled=false, cold_enabled=true, adv_sec_enabled=true, AMAZON_INTERNAL, cross_cluster_transport_address=IP, shard_indexing_pressure_enabled=true, AMAZON_INTERNAL} (tried [1] times) ConnectTransportException[[4283ef20b232bf4a5e8b92e3f80ab1d6][IP] connect_exception]; nested: AnnotatedConnectException[Connection refused: PATH]; nested: ConnectException[Connection refused]; at org.opensearch.transport.TcpTransport$ChannelsConnectedListener.onFailure(TcpTransport.java:991) at org.opensearch.action.ActionListener.lambda$toBiConsumer$2(ActionListener.java:211) at org.opensearch.common.concurrent.CompletableContext.lambda$addListener$0(CompletableContext.java:55) at PATH(CompletableFuture.java:859) at PATH(CompletableFuture.java:837) at PATH(CompletableFuture.java:506) at PATH(CompletableFuture.java:2088) at org.opensearch.common.concurrent.CompletableContext.completeExceptionally(CompletableContext.java:70) at org.opensearch.transport.netty4.Netty4TcpChannel.lambda$addListener$0(Netty4TcpChannel.java:81) at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:578) at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:571) at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:550) at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:491) at io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:616) at io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:609) at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:117) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:321) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:337) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:707) at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:620) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:583) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at PATH(Thread.java:834) Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: PATH Caused by: java.net.ConnectException: Connection refused at PATH(Native Method) at PATH(SocketChannelImpl.java:779) at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:330) at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:334) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:707) at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:620) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:583) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at

Note - I configured net new 2 OpenSearch 1.0 Cluster domain in same VPC and SG and they are able to connect seamlessly for cross-cluster connection. This clearly shows issue is not with Network or Security Groups but conversion from AES -> OS breaks this feature.

Happy to provide more details.

Viral Shah

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.