cas-packone / ambari-impala-service Goto Github PK

Zhihong SHEN，Huajin Wang，两位好：

看到这个项目的版本要求
Impala 2.6 +
Hadoop 2.6 +

我这边的是3.1版本，用hive有点慢，所以想试试impala，没安装成功；请教下兼容上有没有大坑？值不值得踩一下？
Hadoop 3.1.1.3.1.0.0-78（HDP Edition）
Apache Hive (version 3.1.0.3.1.0.0-78)
ambari-server (version2.7.3.0-139)

rpm -ivh impala-server-2.6.0+cdh5.8.0+0-1.cdh5.8.0.p0.111.el7.x86_64.rpm impala-2.6.0+cdh5.8.0+0-1.cdh5.8.0.p0.111.el7.x86_64.rpm
error: Failed dependencies:
hadoop is needed by impala-2.6.0+cdh5.8.0+0-1.cdh5.8.0.p0.111.el7.x86_64
hadoop-hdfs is needed by impala-2.6.0+cdh5.8.0+0-1.cdh5.8.0.p0.111.el7.x86_64
hadoop-yarn is needed by impala-2.6.0+cdh5.8.0+0-1.cdh5.8.0.p0.111.el7.x86_64
hadoop-mapreduce is needed by impala-2.6.0+cdh5.8.0+0-1.cdh5.8.0.p0.111.el7.x86_64
hbase is needed by impala-2.6.0+cdh5.8.0+0-1.cdh5.8.0.p0.111.el7.x86_64
hive >= 0.12.0+cdh5.1.0 is needed by impala-2.6.0+cdh5.8.0+0-1.cdh5.8.0.p0.111.el7.x86_64
zookeeper is needed by impala-2.6.0+cdh5.8.0+0-1.cdh5.8.0.p0.111.el7.x86_64
hadoop-libhdfs is needed by impala-2.6.0+cdh5.8.0+0-1.cdh5.8.0.p0.111.el7.x86_64
avro-libs is needed by impala-2.6.0+cdh5.8.0+0-1.cdh5.8.0.p0.111.el7.x86_64
parquet is needed by impala-2.6.0+cdh5.8.0+0-1.cdh5.8.0.p0.111.el7.x86_64
sentry >= 1.3.0+cdh5.1.0 is needed by impala-2.6.0+cdh5.8.0+0-1.cdh5.8.0.p0.111.el7.x86_64
sentry is needed by impala-2.6.0+cdh5.8.0+0-1.cdh5.8.0.p0.111.el7.x86_64

Transaction check error:
file /var/run/hadoop-hdfs from install of hadoop-hdfs-2.6.0+cdh5.16.1+2848-1.cdh5.16.1.p0.3.el7.x86_64 conflicts with file from package hadoop_2.3.0.0-hdfs-2.7.1_2.3.0.0-1.el7.x86_64

目前测试情况:
hive版本为YDH默认版本
impala测试版本为(2.6.0-cdh5.8.5, 2.6.0-cdh5.8.0, 2.5.0-cdh5.7.0)
测试用表:
CREATE TABLE backup.test ( name STRING ) PARTITIONED BY ( id INT );
测试用动态分区语句:
insert into table backup.test
partition(id)
select 'a',1

NoSuchMethodError: setCaching. I am using VERSION 3.1 of HDFS2.0.23 of Hbase package and 3.1 of Hive. I am using existing Hbase package 1.2.6 of Hive package 1.2.0 of Hadoop Authentication 2.7.2 of Impalad

我们使用了这个项目在ambari上安装impala。但是遇到了一些问题：

• 首先是写在 /etc/default/bigtop-utils里的JAVA_HOME为何固定了是/usr/jdk64？我想在脚本中应该可以根据用户本身的JAVAHOME环境变量来做出改变。

• 另一个是关于 package/templates/impala.j2这个文件中的ENABLE_CORE_DUMPS=false。在impala日志中出现的错误信息如下：

Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again

然后根据这个网址，提示我们应将ENABLE_CORE_DUMPS=false改为ENABLE_CORE_DUMPS=true才能看到错误提示。我想知道这个变量有什么特殊的意义吗？而且在每次运行之前都进行一次配置文件的重新写入是否有意义？

如果能获得允许的话，我希望能向你们提一个pull request。