Comments (3)
Is it possible that you've edited your hive-site.xml? I know that there are some datanucleus configurations in hive-site.xml.
For completeness sake, I've verified also that my local hive installation is working. I'm using a local mysql as my metastore backend (as configured in hadoop's hive-site.xml)
> hive -e "create table test_table(c1 string);"
....
OK
Time taken: 1.526 seconds
> hive -e "show tables;"
...
OK
test_table
from iceberg.
@fbocse I just attempted to reproduce this issue on my macbook with no success. I have never experienced this issue, but I've also never hived much outside of a real hadoop cluster.
TLDR: You might have already tried this, but have you tried ./gradlew clean
?
I had hive 2.x installed locally, but HIVE_HOME was not set. I ran ./gradlew test
and everything succeeded. I then brew upgrade hive
to ensure I was on the same version as you and then set HIVE_HOME to attempt to replicate this.
> brew upgrade hive
.... get coffee
> hive --version
# Manually setting it as homebrew install didn't set it for me.
> HIVE_HOME=/usr/local/bin/hive
> echo $HIVE_HOME
/usr/local/bin/hive
> ls -las $HIVE_HOME
.... /usr/local/bin/hive -> ../Cellar/hive/3.1.1/bin/hive
# Verified we're on the same version
> hive --version
SLF4J: Typical classpath shenanigans.
....
Hive 3.1.1
Git git://daijymacpro-2.local/Users/daijy/commit/hive -r f4e0529634b6231a0072295da48af466cf2f10b7
Compiled by daijy on Tue Oct 23 17:19:24 PDT 2018
From source with checksum 6deca5a8401bbb6c6b49898be6fcb80e
# Check that all of my previous tests passed
> ./gradlew test
33 actionable tasks: 33 up-to-date
# Clean and retest everything,
> echo $HIVE_HOME && ./gradlew clean test
/usr/local/bin/hive
# Some gradle output, which included 4/4 passing tests from :iceberg-hive
> Configure project : ...
... pet the dog ....
BUILD SUCCESSFUL in 3m 32s
33 actionable tasks: 33 executed
This might be due to differences in our environments, such as in how our hive installations were performed etc. But a good old ./gradlew clean
might help out if you haven't tried it. I'm not super familiar with gradle myself (mostly I've used pants or bazel), so ignore this advice if it was painfully obvious already :)
from iceberg.
Thanks for trying to reproduce, @kbendick. I'm going to close this, but feel free to reopen if it turns out to be a problem.
from iceberg.
Related Issues (20)
- Iceberg Hidden Partitioning and Spark SQL Wide Transformation Optimization
- does iceberg can run on k8s? HOT 6
- REST Catalog to support custom-catalog name like HMS/Glue HOT 9
- Copy-on-Write behaviour with Flink Data Stream API HOT 2
- Iceberg rest catalog with postgres - List namespaces with parent returns wrong children namespaces
- Is the "Emitting watermarks" new feature can't be used in flink sql? HOT 9
- AWS: Updating Glue catalog table removes column descriptions HOT 1
- MinIO + Spark + hive metadata + iceberg format
- byte and short types in spark no longer auto coerce to int32 HOT 7
- AWS: Creating a Glue table with Lake Formation enabled fails HOT 1
- How to reinitialize/refresh iceberg catalog object in spark catalog on an ongoing spark session HOT 1
- Spark: Dropping partition column from old partition table corrupts entire table HOT 7
- Flink/Azure job graph serialization fails when used with storage account shared key authentication HOT 1
- Spark: CDC does not respect when the table is rolled back. HOT 2
- Documentation page returning 404 HOT 1
- Getting storage partitioned join to work HOT 1
- `iceberg-spark-runtime-3.3_2.12-1.5.1` seems to be compiled with a mismatched scala version HOT 16
- Renaming of ConfVars Enums in Apache Hive breaks compatibility of HiveCatalog dependency in Apache Iceberg HOT 8
- org.apache.iceberg.expressions.(Max/Min)Aggregate Don't handle null DataFile.(upper/lower)Bounds() HOT 2
- Geospatial Support HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from iceberg.