Comments (5)
Hi @djKooks,
It looks like you're directing the HiveServer2Client
to the SSH port of the remote service, which is almost certainly not what you want to do. Do you have a HiveServer2 instance running?
from omniduct.
@matthewwardrop thanks for reply.
Yes, I'm trying to access hive in remote machine(virtualbox instance). If my usage is wrong, please let me know.
Thanks.
from omniduct.
If the remote machine has a hiveserver2 instance, and the ports associated with the instance are exposed, you can just directly connect to it.
from omniduct.databases.hiveserver2 import HiveServer2Client
hsc = HiveServer2Client(
host='192.168.56.1', # IP address of virtual machine
port=3623, # Port of HiveServer2 instance (typically 3623)
driver='pyhive' # Recommended over impyla
)
hsc.connect()
If the HiveServer2 instance is not exposed, then you will need to use port-forwarding via SSH.
from omniduct.databases.hiveserver2 import HiveServer2Client
from omniduct.remotes.ssh import SSHClient
remote = SSHClient(
host='192.168.56.1', # IP address of virtual machine
port=22, # Port of SSH server
)
hsc = HiveServer2Client(
host='127.0.0.1', # IP address of localhost
port=3623, # Port of HiveServer2 instance (typically 3623)
remote=remote
)
hsc.connect()
Hope that helps.
from omniduct.
@matthewwardrop thanks! I'll check again later and let you know.
from omniduct.
@matthewwardrop sorry for late.
It seems it is problem of hive server connection, because it also causes on other modules such as pyhive or impyla.
I'll reopen it if I found a problem in here.
Thanks.
from omniduct.
Related Issues (20)
- v1.1.4 breaks SSHClient HOT 3
- It is not safe to use "input" in python2 HOT 1
- DatabaseClient stream() and stream_to_file()
- If table exists, then append and replace do not work when adding a dataframe to a table HOT 2
- ssh connect error HOT 1
- Druid Connection HOT 1
- Connecting to presto through https HOT 6
- More examples HOT 6
- Hive DataFrame columns and push errors HOT 4
- Some issues for cassandra protocol HOT 3
- tests? HOT 1
- missing checks in _mkdir method in LocalFsClient HOT 10
- implementation of mkdir and remove for s3 filesystem HOT 1
- Implement Azure Data Lake Client HOT 2
- REST implement put and post the data ? HOT 2
- Hive dataframe_to_table failing on non-remote execution
- logo HOT 11
- Nonstandard YAML config format results in crash HOT 10
- Handling connection failover HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from omniduct.