Git Product home page Git Product logo

tutorial-201203-big-data's Issues

Pbl when excute example in R

Hi,
I follow the tutorial n`1 step by step and the all steps works very well except when I run code from R.
When I run the code below (with rmr-1-3)
cd
cd hadoop-r/airline/src/deptdelay_by_month/R/rmr/
export HADOOP_HOME=/usr/lib/hadoop
R

source('deptdelay-rmr12.R')
df = from.dfs(deptdelay("asa-airline/data", "asa-airline/out/deptdelaymonth-rmr"), to.data.frame=T)

I got this ERROR
packageJobJar: [/tmp/Rtmpylb4Ru/rmr-local-env, /tmp/Rtmpylb4Ru/rmr-global-env, /tmp/Rtmpylb4Ru/rhstr.map162538ef196a, /tmp/Rtmpylb4Ru/rhstr.reduce162517b13536, /var/lib/hadoop-0.20/cache/cloudera/hadoop-unjar5179862963461612531/] [] /tmp/streamjob9098009061696069986.jar tmpDir=null
12/09/16 12:05:26 WARN snappy.LoadSnappy: Snappy native library is available
12/09/16 12:05:26 INFO util.NativeCodeLoader: Loaded the native-hadoop library
12/09/16 12:05:26 INFO snappy.LoadSnappy: Snappy native library loaded
12/09/16 12:05:26 INFO mapred.FileInputFormat: Total input paths to process : 1
12/09/16 12:05:26 INFO streaming.StreamJob: getLocalDirs(): [/var/lib/hadoop-0.20/cache/cloudera/mapred/local]
12/09/16 12:05:26 INFO streaming.StreamJob: Running job: job_201209161135_0006
12/09/16 12:05:26 INFO streaming.StreamJob: To kill this job, run:
12/09/16 12:05:26 INFO streaming.StreamJob: /usr/lib/hadoop/bin/hadoop job -Dmapred.job.tracker=0.0.0.0:8021 -kill job_201209161135_0006
12/09/16 12:05:26 INFO streaming.StreamJob: Tracking URL: http://0.0.0.0:50030/jobdetails.jsp?jobid=job_201209161135_0006
12/09/16 12:05:27 INFO streaming.StreamJob: map 0% reduce 0%
12/09/16 12:06:05 INFO streaming.StreamJob: map 100% reduce 100%
12/09/16 12:06:05 INFO streaming.StreamJob: To kill this job, run:
12/09/16 12:06:05 INFO streaming.StreamJob: /usr/lib/hadoop/bin/hadoop job -Dmapred.job.tracker=0.0.0.0:8021 -kill job_201209161135_0006
12/09/16 12:06:06 INFO streaming.StreamJob: Tracking URL: http://0.0.0.0:50030/jobdetails.jsp?jobid=job_201209161135_0006
12/09/16 12:06:06 ERROR streaming.StreamJob: Job not successful. Error: NA
12/09/16 12:06:06 INFO streaming.StreamJob: killJob...
Streaming Command Failed!
Error in mr(map = map, reduce = reduce, combine = combine, in.folder = if (is.list(input)) { :
hadoop streaming failed with error code 1

I don't know what kind of information can be usefull to debug that.
I'm at your disposal...
Any idea ?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.