Comments (14)
doddys
commented on June 22, 2024
Setting up lab requirement
- hue sample data
from sebc.
doddys
commented on June 22, 2024
Having problem with hue
Current value: http://ec2-13-250-20-43.ap-southeast-1.compute.amazonaws.com:50070/webhdfs/v1
Failed to access filesystem root
from sebc.
doddys
commented on June 22, 2024
Apparently hue was pointing to passive namenode. After changing to active namenode and restart it works
from sebc.
doddys
commented on June 22, 2024
having problem activating kerberos
-
due to firewall setting
Need to open port
TCP : 464, 88 , 749
UDP :646, 88 -
JCE is not put in the correct folder JAVA_HOME/jre/lib/security
from sebc.
doddys
commented on June 22, 2024
Fixed the kerberos isu by updating executing the following command
modprinc -maxlife 1days -maxrenewlife 7days +allow_renewable krbtgt/[email protected]
but now got a different problem:
18/05/16 12:20:32 WARN security.UserGroupInformation: PriviledgedActionException as:hdfs (auth:KERBEROS) cause:javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]
18/05/16 12:20:32 WARN ipc.Client: Exception encountered while connecting to the server : javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]
18/05/16 12:20:32 WARN security.UserGroupInformation: PriviledgedActionException as:hdfs (auth:KERBEROS) cause:java.io.IOException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]
ls: Failed on local exception: java.io.IOException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]; Host Details : local host is: "hadoop5.expecc.com/172.30.1.187"; destination host is: "hadoop5.expecc.com":8020;
from sebc.
doddys
commented on June 22, 2024
Apparently, this is an expected behaviour. In order to execute command as hdfs user, we need to use hdfs.keytab to acquire kerberos ticket
from sebc.
doddys
commented on June 22, 2024
Another Problem: Canary Service is not working.
This problem is resolve by opening port 1004.
from sebc.
doddys
commented on June 22, 2024
Next Problem : Try to run teragen
Error:
18/05/16 16:05:08 WARN security.UserGroupInformation: PriviledgedActionException as:[email protected] (auth:KERBEROS) cause:java.io.IOException: Can't get Master Kerberos principal for use as renewer
java.io.IOException: Can't get Master Kerberos principal for use as renewer
at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:133)
at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:100)
from sebc.
doddys
commented on June 22, 2024
add gateway role to the node where I execute the error resolve "renewer" issue but
iagnostics: Application application_1526485969852_0001 initialization failed (exitCode=255) with output: main : command provided 0
main : run as user is doddys
main : requested yarn user is doddys
Can't create directory /yarn/nm/usercache/doddys/appcache/application_1526485969852_0001 - Permission denied
Did not create any app directories
Failing this attempt. Failing the application.
18/05/16 16:18:33 INFO mapreduce.Job: Counters: 0
from sebc.
doddys
commented on June 22, 2024
fixed yarn isu:
rm /yarn/nm/usercache/*
on all data nodes
from sebc.
doddys
commented on June 22, 2024
final result submitted
from sebc.
doddys
commented on June 22, 2024
I missed the sentry lab.
Starting Sentry Lab now
from sebc.
doddys
commented on June 22, 2024
Sentry Lab is completed.
Please Review
from sebc.
endlesscyl
commented on June 22, 2024
add gateway role to the node
hi,doddys：
I also have same error "Can't get Master Kerberos principal for use as renewer"，how did you solve it?
from sebc.
Related Issues (20)
- Challenges Setup HOT 2
- Install Database HOT 4
- Install CM HOT 4
- Install CDH HOT 5
- Test HDFS HOT 2
- Kerberize cluster HOT 5
- Install Sentry HOT 3
- Exit-test: Setup HOT 1
- Exit-test: Install Database HOT 2
- Exit-test: Install CM HOT 2
- Exit-test: Install CDH HOT 7
- Exit-test: Test HDFS HOT 1
- Exit-test: Kerberize cluster HOT 3
- Exit-test: Install Sentry HOT 3
- Exit-test: CM chart HOT 1
- Resource Lab HOT 6
- CM managing multiple different CDH Cluster
- CM Monitoring Lab HOT 5
- HUE Lab HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sebc.