finn-no / cassandra-hadoop Goto Github PK

Having a first node in columnfamilysplit down, whole connector fails:

java.lang.RuntimeException: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused
        at org.apache.cassandra.hadoop2.cql3.CqlPagingRecordReader.initialize(CqlPagingRecordReader.java:150)
       [...]       
Caused by: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused
        at org.apache.thrift.transport.TSocket.open(TSocket.java:185)
        at org.apache.thrift.transport.TFramedTransport.open(TFramedTransport.java:81)
        at org.apache.cassandra.thrift.TFramedTransportFactory.openTransport(TFramedTransportFactory.java:41)
        at org.apache.cassandra.hadoop2.AbstractColumnFamilyInputFormat.createAuthenticatedClient(AbstractColumnFamilyInputFormat.java:94)
        at org.apache.cassandra.hadoop2.cql3.CqlPagingRecordReader.initialize(CqlPagingRecordReader.java:141)
        ... 33 more

I think the problem is in the way connecting is done - i.e. that we try to connect to single node, identified by org.apache.cassandra.hadoop2.cql3.CqlPagingRecordReader#getLocation https://github.com/finn-no/cassandra-hadoop/blob/master/src/main/java/org/apache/cassandra/hadoop2/cql3/CqlPagingRecordReader.java#L213
and failure is propagated in https://github.com/finn-no/cassandra-hadoop/blob/master/src/main/java/org/apache/cassandra/hadoop2/cql3/CqlPagingRecordReader.java#L150

Maybe there is some way to connect using multiple nodes, or, if not - catch cassandra connection exception and retry with next node

Hi Mike,

We are getting the exception below trying to use the implementation with Cloudera 4.4 which uses older version of SLF4J (1.6.1). Any chance you will be willing to update the code to use older SLF4J? Say, logger.debug(String) instead of logger.debug(String,Object)?

Regards,
Dmitry Vasilenko

java.lang.NoSuchMethodError: org/slf4j/helpers/MessageFormatter.format(Ljava/lang/String;Ljava/lang/Object;)Ljava/lang/String;
at org.slf4j.impl.Log4jLoggerAdapter.debug(Log4jLoggerAdapter.java:223)
at org.apache.cassandra.hadoop2.cql3.CqlPagingRecordReader.retrieveKeys(CqlPagingRecordReader.java:673)
at org.apache.cassandra.hadoop2.cql3.CqlPagingRecordReader.initialize(CqlPagingRecordReader.java:144)
at org.apache.hadoop.hive.cassandra.input.cql.CqlHiveRecordReader.initialize(CqlHiveRecordReader.java:91)
at org.apache.hadoop.hive.cassandra.input.cql.HiveCqlInputFormat.getRecordReader(HiveCqlInputFormat.java:101)